Webscraping and Visualizing the Top CryptoCurrencies

Top Cryptocurrencies According to Price and Market Cap

Webscraping
Data Visualization
Author

Olamide Adu

Published

June 7, 2024

Cryptocurrencies have captivated the financial world, bringing immense joy to some and heartache to many. One thing is certain: when you get it right and strike gold with cryptocurrencies, it can set you up for life (depending on your frugality and investment amount). As a data scientist, I know the thrill of diving into this dynamic market.

This post, however, isn’t about trading strategies or price forecasting. Instead, it’s a exploring the capabilities of R in web scraping using the rvest package. Since I like to spend time in creating good visuals, I will be making some interesting visualization here.

Getting Our data

First, I scraped data from CoinMarketCap using the URL https://coinmarketcap.com/all/views/all/. The code extracts a specific table and selects relevant columns like name, symbol, market cap, and price.

Show the code 
library(pacman)
p_load(rvest, tidyverse, magick, ggimage)

url <- "https://coinmarketcap.com/all/views/all/"

crypto <- read_html(url) |> 
  html_nodes("table") |> 
  html_table()

crypto <- crypto[[3]]

head(crypto)
# A tibble: 6 × 1,001
   Rank Name        Symbol `Market Cap` Price `Circulating Supply` `Volume(24h)`
  <int> <chr>       <chr>  <chr>        <chr> <chr>                <chr>        
1     1 BTCBitcoin  BTC    $2.36T$2,36… $118… 19,899,759 BTC       $72,391,923,…
2     2 ETHEthereum ETH    $467.36B$46… $3,8… 120,710,196 ETH *    $36,063,205,…
3     3 XRPXRP      XRP    $187.5B$187… $3.16 59,239,646,627 XRP * $6,534,634,9…
4     4 USDTTether… USDT   $163.74B$16… $0.9… 163,751,876,809 USD… $121,942,357…
5     5 BNBBNB      BNB    $112.51B$11… $807… 139,288,431 BNB *    $2,640,378,7…
6     6 SOLSolana   SOL    $97.92B$97,… $181… 538,169,104 SOL *    $5,919,966,5…
# ℹ 994 more variables: `% 1h` <chr>, `% 24h` <chr>, `% 7d` <chr>, `` <lgl>,
#   `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>,
#   `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>,
#   `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>,
#   `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>,
#   `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>,
#   `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, `` <lgl>, …

Data Exploration and Cleaning

I started by cleaning the column names using janitor::clean_names() and selecting the columns I needed. Then, I ensured data types were appropriate by converting market_cap and price to numeric values.

Show the code 
crypto <- crypto |> 
  janitor::clean_names() |> 
  select(name, symbol, market_cap, price)

glimpse(crypto)
Rows: 200
Columns: 4
$ name       <chr> "BTCBitcoin", "ETHEthereum", "XRPXRP", "USDTTether USDt", "…
$ symbol     <chr> "BTC", "ETH", "XRP", "USDT", "BNB", "SOL", "USDC", "DOGE", …
$ market_cap <chr> "$2.36T$2,362,585,749,349", "$467.36B$467,356,434,607", "$1…
$ price      <chr> "$118,699.30", "$3,871.41", "$3.16", "$0.9999", "$807.75", …

Is the data structure as expected? From the data which we have above, there are some columns that needs their data types changed. The market_cap and price column should be numeric/double data type and not character.

Show the code 
crypto <- crypto |> 
  mutate(
    market_cap = str_remove_all(market_cap, r"--[\$[\d.]+[TB]]--"),
    market_cap = parse_number(market_cap),
    price = parse_number(price)
  )

str(crypto)
tibble [200 × 4] (S3: tbl_df/tbl/data.frame)
 $ name      : chr [1:200] "BTCBitcoin" "ETHEthereum" "XRPXRP" "USDTTether USDt" ...
 $ symbol    : chr [1:200] "BTC" "ETH" "XRP" "USDT" ...
 $ market_cap: num [1:200] 2.36e+12 4.67e+11 1.88e+11 1.64e+11 1.13e+11 ...
 $ price     : num [1:200] 1.19e+05 3.87e+03 3.16 1.00 8.08e+02 ...

Handling missing Data

I used the skimr package to identify missing data. The code then filtered the crypto data frame to keep only complete rows with values in all columns.

Show the code 
skimr::n_missing(crypto)
[1] 360
Show the code 
skimr::skim(crypto)
Data summary
Name crypto
Number of rows 200
Number of columns 4
_______________________
Column type frequency:
character 2
numeric 2
________________________
Group variables None

Variable type: character

skim_variable n_missing complete_rate min max empty n_unique whitespace
name 0 1 2 37 0 200 0
symbol 0 1 0 4 180 21 0

Variable type: numeric

skim_variable n_missing complete_rate mean sd p0 p25 p50 p75 p100 hist
market_cap 180 0.1 1.830286e+11 5.242903e+11 8.416123e+09 1.164774e+10 2.122425e+10 1.015685e+11 2.362586e+12 ▇▁▁▁▁
price 180 0.1 6.217850e+03 2.648964e+04 2.200000e-01 9.500000e-01 3.720000e+00 1.286600e+02 1.186993e+05 ▇▁▁▁▁
Show the code 
crypto <- crypto[complete.cases(crypto), ]
skimr::skim_without_charts(crypto)
Data summary
Name crypto
Number of rows 20
Number of columns 4
_______________________
Column type frequency:
character 2
numeric 2
________________________
Group variables None

Variable type: character

skim_variable n_missing complete_rate min max empty n_unique whitespace
name 0 1 6 15 0 20 0
symbol 0 1 3 4 0 20 0

Variable type: numeric

skim_variable n_missing complete_rate mean sd p0 p25 p50 p75 p100
market_cap 0 1 1.830286e+11 5.242903e+11 8.416123e+09 1.164774e+10 2.122425e+10 1.015685e+11 2.362586e+12
price 0 1 6.217850e+03 2.648964e+04 2.200000e-01 9.500000e-01 3.720000e+00 1.286600e+02 1.186993e+05

Data Visualization

Now, let’s visualize the data! I created a donut chart to represent the market cap distribution of the top six cryptocurrencies. The remaining currencies are grouped into an “Other” category.

The code calculates the market cap share for each currency, along with cumulative values and labels for the chart.

Show the code 
crypto <- crypto |> 
  mutate(
    new_sym = fct_lump(
      symbol, n = 6, w = market_cap
    )
  )

crypto |> 
  summarize(
    .by = new_sym,
    market_cap = sum(market_cap),
    count = n()
  )
Table 1: Top Six Cryptocurrencies according to Market Capitalization 
# A tibble: 7 × 3
  new_sym    market_cap count
  <fct>           <dbl> <int>
1 BTC     2362585749349     1
2 ETH      467356434607     1
3 XRP      187503948068     1
4 USDT     163741940923     1
5 BNB      112508144016     1
6 SOL       97921898217     1
7 Other    268953092294    14

Table 1 shows that the market cap has been compressed into 7, 6 for the top cryptocurrency and 14 lumped together into a new category, Other.

Show the code 
crypto_summary <- crypto |> 
  summarize(
    .by = new_sym,
    market_cap = sum(market_cap)
  ) |> 
  mutate(
    prop = market_cap/sum(market_cap) * 100,
    market_cap = round(market_cap/1e9, 2),
    market_cap = paste0(market_cap, " B"),
    ymax = cumsum(prop),
    ymin = c(0, head(ymax, n = -1)),
    lab_pos = (ymax + ymin)/2,
    label = paste0(new_sym, "\nValue: ",round(prop, 2), "%")
  )

Crytocurrencies by Market Capitalization

Show the code 
ggplot(
  crypto_summary,
  aes(xmin = 3, xmax = 4,ymin = ymin, ymax = ymax, fill = new_sym)
) +
  geom_rect() +
  expand_limits(x = c(1.5, 4)) +
  coord_polar(theta = "y", start = 1) +
  scale_fill_brewer(palette ="YlOrRd") +
  theme_void() +
  ggrepel::geom_label_repel(
    x = 3,
    aes(y = lab_pos, label = label),
    size = 2,
    col = "gray3"
  ) +
  theme_void() +
  ggtitle("Market Cap of Top Cryptocurrencies") +
  theme(
    legend.position = "none"
  )
Figure 1: Crypto Asset Market Cap

As shown in Figure 1 Bitcoin, and ETH are clearly dominating the crypto space in market capitalization. Assets such as BNB, SOL and USDT are slowly increasing their dominance ranging from 3 - 6%.

Top 20 Cryptocurrencies Price

{.justify} I downloaded logos for the top 20 cryptocurrencies and added them as an “images” column to the data frame.

The code then creates a bar chart to visualize individual cryptocurrency prices, with labels indicating the price for each currency.

Show the code 
images <- list.files(path = "images", full.names = TRUE)

crypto <- crypto |> 
  arrange(symbol) |> 
  bind_cols("images" = images)

crypto_img <- crypto |> 
  mutate(
    images = paste0("<img src='", images, "' width='15'/>")
  )

Now we can visualize the prices of each asset.

Show the code 
crypto_img |> 
  ggplot(aes(price, fct_reorder(images, price))) +
  geom_col(
    width = .1,
    fill = "#FBD25B"
  ) +
  geom_label(
    aes(label = round(price, 2)),
    col = "white",
    fill = "#AE1D0E",
    size = 2.5
  ) +
  labs(
    title = "Price of the Top 20 Cryptocurrencies"
  ) +
  scale_x_log10(label = scales::label_number()) +
  theme_minimal() +
  theme(
    axis.text.y = ggtext::element_markdown(),
    axis.text.x = element_blank(),
    axis.ticks = element_blank(),
    axis.title = element_blank(),
    plot.title = element_text(hjust = .5, color = "#AE1D0E")
  )

Conclusion

In this project, I successfully scraped cryptocurrency data, cleaned it for analysis, and created visualizations to explore market cap distribution and individual cryptocurrency prices. This process demonstrates the power of web scraping and data visualization in R. Interesting thing is, whenever this page is reloaded, you will always have the most recent price, but do not trust the visuals as the logo may get displaced already. I should develop a shiny app for this instead