🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 115 (from laksa171)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa115.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://homepage.divms.uiowa.edu/~mbognar/applets/beta.html\')), getAhrefsUnparsedNoserviceFromURL(\'https://homepage.divms.uiowa.edu/~mbognar/applets/beta.html\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/homepage.divms.uiowa.edu\/~mbognar\/applets\/beta.html","crawl_time":1774875808,"first_indexed_time":1529525665,"http_code":200,"src_unparsed":"edu,uiowa!divms,homepage,\/~mbognar\/applets\/beta.html s443","src_root_hash":"15749649359141072315","history_drop_reason":null,"meta_title":"Beta Distribution Applet\/Calculator","meta_descriptions":[],"attrs_boilerpipe_text":"This applet computes probabilities and percentiles for beta random variables:\n$$X \\sim Beta(\\alpha, \\beta)$$\nDirections\nEnter the shape $\\alpha$ and the shape $\\beta$.\nTo compute a left-tail probability, select $P(X \\lt x)$ from the drop-down box, \nenter a numeric $x$ value in the\nblue\nbox and press \"Enter\" or \"Tab\" on your keyboard. The probability $P(X \\lt x)$ will appear in the\npink\nbox.\nSelect $P(X \\gt x)$ from the drop-down box for a right-tail probability.\nTo determine a percentile, enter the percentile (e.g. use 0.8 for the 80th percentile) in the\npink\nbox and select $P(X \\lt x)$ from the drop-down box and press \"Tab\" or \"Enter\" on your keyboard. \nThe percentile $x$ will appear in the\nblue\nbox.\nOn the graph, the $x$ value appears in\nblue\nwhile the probability is shaded in\npink\n.\nDetails\nProbability density function\n$$f(x)=\\frac{\\Gamma(\\alpha+\\beta)}{\\Gamma(\\alpha)\\Gamma(\\beta)} x^{\\alpha-1} (1-x)^{\\beta-1}$$\nwhere $0 \\le x \\le 1$, $\\alpha > 0$, and $\\beta > 0$\n$\\mu=E(X)=\\frac{\\alpha}{\\alpha+\\beta}$\n$\\sigma^2=Var(X)=\\frac{\\alpha\\beta}{(\\alpha+\\beta)^2(\\alpha+\\beta+1)}$\n$\\sigma=SD(X)=\\sqrt{\\frac{\\alpha\\beta}{(\\alpha+\\beta)^2(\\alpha+\\beta+1)}}$","attrs_markdown":"### Beta Distribution \\$X \\\\sim Beta(\\\\alpha, \\\\beta)\\$\nHelp\n\n©2025 Matt Bognar  \n Department of Statistics and Actuarial Science  \n University of Iowa\n\nThis applet computes probabilities and percentiles for beta random variables: \\$\\$X \\\\sim Beta(\\\\alpha, \\\\beta)\\$\\$\n\n#### Directions\n- Enter the shape \\$\\\\alpha\\$ and the shape \\$\\\\beta\\$.\n- To compute a left-tail probability, select \\$P(X \\\\lt x)\\$ from the drop-down box, enter a numeric \\$x\\$ value in the blue box and press \"Enter\" or \"Tab\" on your keyboard. The probability \\$P(X \\\\lt x)\\$ will appear in the pink box. Select \\$P(X \\\\gt x)\\$ from the drop-down box for a right-tail probability.\n- To determine a percentile, enter the percentile (e.g. use 0.8 for the 80th percentile) in the pink box and select \\$P(X \\\\lt x)\\$ from the drop-down box and press \"Tab\" or \"Enter\" on your keyboard. The percentile \\$x\\$ will appear in the blue box.\n\nOn the graph, the \\$x\\$ value appears in blue while the probability is shaded in pink.\n\n#### Details\n- Probability density function \\$\\$f(x)=\\\\frac{\\\\Gamma(\\\\alpha+\\\\beta)}{\\\\Gamma(\\\\alpha)\\\\Gamma(\\\\beta)} x^{\\\\alpha-1} (1-x)^{\\\\beta-1}\\$\\$ where \\$0 \\\\le x \\\\le 1\\$, \\$\\\\alpha \\> 0\\$, and \\$\\\\beta \\> 0\\$\n- \\$\\\\mu=E(X)=\\\\frac{\\\\alpha}{\\\\alpha+\\\\beta}\\$\n- \\$\\\\sigma^2=Var(X)=\\\\frac{\\\\alpha\\\\beta}{(\\\\alpha+\\\\beta)^2(\\\\alpha+\\\\beta+1)}\\$\n- \\$\\\\sigma=SD(X)=\\\\sqrt{\\\\frac{\\\\alpha\\\\beta}{(\\\\alpha+\\\\beta)^2(\\\\alpha+\\\\beta+1)}}\\$","attrs_readable_markdown":"This applet computes probabilities and percentiles for beta random variables: \\$\\$X \\\\sim Beta(\\\\alpha, \\\\beta)\\$\\$\n\n#### Directions\n- Enter the shape \\$\\\\alpha\\$ and the shape \\$\\\\beta\\$.\n- To compute a left-tail probability, select \\$P(X \\\\lt x)\\$ from the drop-down box, enter a numeric \\$x\\$ value in the blue box and press \"Enter\" or \"Tab\" on your keyboard. The probability \\$P(X \\\\lt x)\\$ will appear in the pink box. Select \\$P(X \\\\gt x)\\$ from the drop-down box for a right-tail probability.\n- To determine a percentile, enter the percentile (e.g. use 0.8 for the 80th percentile) in the pink box and select \\$P(X \\\\lt x)\\$ from the drop-down box and press \"Tab\" or \"Enter\" on your keyboard. The percentile \\$x\\$ will appear in the blue box.\n\nOn the graph, the \\$x\\$ value appears in blue while the probability is shaded in pink.\n\n#### Details\n- Probability density function \\$\\$f(x)=\\\\frac{\\\\Gamma(\\\\alpha+\\\\beta)}{\\\\Gamma(\\\\alpha)\\\\Gamma(\\\\beta)} x^{\\\\alpha-1} (1-x)^{\\\\beta-1}\\$\\$ where \\$0 \\\\le x \\\\le 1\\$, \\$\\\\alpha \\> 0\\$, and \\$\\\\beta \\> 0\\$\n- \\$\\\\mu=E(X)=\\\\frac{\\\\alpha}{\\\\alpha+\\\\beta}\\$\n- \\$\\\\sigma^2=Var(X)=\\\\frac{\\\\alpha\\\\beta}{(\\\\alpha+\\\\beta)^2(\\\\alpha+\\\\beta+1)}\\$\n- \\$\\\\sigma=SD(X)=\\\\sqrt{\\\\frac{\\\\alpha\\\\beta}{(\\\\alpha+\\\\beta)^2(\\\\alpha+\\\\beta+1)}}\\$","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

19 days ago

🚫

ROBOTS BLOCKED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0.7 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://homepage.divms.uiowa.edu/~mbognar/applets/beta.html
Last Crawled	2026-03-30 13:03:28 (19 days ago)
First Indexed	2018-06-20 20:14:25 (7 years ago)
HTTP Status Code	200
Meta Title	Beta Distribution Applet/Calculator
Meta Description	null
Meta Canonical	null
Boilerpipe Text	This applet computes probabilities and percentiles for beta random variables: $$X \sim Beta(\alpha, \beta)$$ Directions Enter the shape $\alpha$ and the shape $\beta$. To compute a left-tail probability, select $P(X \lt x)$ from the drop-down box, enter a numeric $x$ value in the blue box and press "Enter" or "Tab" on your keyboard. The probability $P(X \lt x)$ will appear in the pink box. Select $P(X \gt x)$ from the drop-down box for a right-tail probability. To determine a percentile, enter the percentile (e.g. use 0.8 for the 80th percentile) in the pink box and select $P(X \lt x)$ from the drop-down box and press "Tab" or "Enter" on your keyboard. The percentile $x$ will appear in the blue box. On the graph, the $x$ value appears in blue while the probability is shaded in pink . Details Probability density function $$f(x)=\frac{\Gamma(\alpha+\beta)}{\Gamma(\alpha)\Gamma(\beta)} x^{\alpha-1} (1-x)^{\beta-1}$$ where $0 \le x \le 1$, $\alpha > 0$, and $\beta > 0$ $\mu=E(X)=\frac{\alpha}{\alpha+\beta}$ $\sigma^2=Var(X)=\frac{\alpha\beta}{(\alpha+\beta)^2(\alpha+\beta+1)}$ $\sigma=SD(X)=\sqrt{\frac{\alpha\beta}{(\alpha+\beta)^2(\alpha+\beta+1)}}$
Markdown	### Beta Distribution \$X \\sim Beta(\\alpha, \\beta)\$ Help ©2025 Matt Bognar Department of Statistics and Actuarial Science University of Iowa This applet computes probabilities and percentiles for beta random variables: \$\$X \\sim Beta(\\alpha, \\beta)\$\$ #### Directions - Enter the shape \$\\alpha\$ and the shape \$\\beta\$. - To compute a left-tail probability, select \$P(X \\lt x)\$ from the drop-down box, enter a numeric \$x\$ value in the blue box and press "Enter" or "Tab" on your keyboard. The probability \$P(X \\lt x)\$ will appear in the pink box. Select \$P(X \\gt x)\$ from the drop-down box for a right-tail probability. - To determine a percentile, enter the percentile (e.g. use 0.8 for the 80th percentile) in the pink box and select \$P(X \\lt x)\$ from the drop-down box and press "Tab" or "Enter" on your keyboard. The percentile \$x\$ will appear in the blue box. On the graph, the \$x\$ value appears in blue while the probability is shaded in pink. #### Details - Probability density function \$\$f(x)=\\frac{\\Gamma(\\alpha+\\beta)}{\\Gamma(\\alpha)\\Gamma(\\beta)} x^{\\alpha-1} (1-x)^{\\beta-1}\$\$ where \$0 \\le x \\le 1\$, \$\\alpha \> 0\$, and \$\\beta \> 0\$ - \$\\mu=E(X)=\\frac{\\alpha}{\\alpha+\\beta}\$ - \$\\sigma^2=Var(X)=\\frac{\\alpha\\beta}{(\\alpha+\\beta)^2(\\alpha+\\beta+1)}\$ - \$\\sigma=SD(X)=\\sqrt{\\frac{\\alpha\\beta}{(\\alpha+\\beta)^2(\\alpha+\\beta+1)}}\$
Readable Markdown	This applet computes probabilities and percentiles for beta random variables: \$\$X \\sim Beta(\\alpha, \\beta)\$\$ #### Directions - Enter the shape \$\\alpha\$ and the shape \$\\beta\$. - To compute a left-tail probability, select \$P(X \\lt x)\$ from the drop-down box, enter a numeric \$x\$ value in the blue box and press "Enter" or "Tab" on your keyboard. The probability \$P(X \\lt x)\$ will appear in the pink box. Select \$P(X \\gt x)\$ from the drop-down box for a right-tail probability. - To determine a percentile, enter the percentile (e.g. use 0.8 for the 80th percentile) in the pink box and select \$P(X \\lt x)\$ from the drop-down box and press "Tab" or "Enter" on your keyboard. The percentile \$x\$ will appear in the blue box. On the graph, the \$x\$ value appears in blue while the probability is shaded in pink. #### Details - Probability density function \$\$f(x)=\\frac{\\Gamma(\\alpha+\\beta)}{\\Gamma(\\alpha)\\Gamma(\\beta)} x^{\\alpha-1} (1-x)^{\\beta-1}\$\$ where \$0 \\le x \\le 1\$, \$\\alpha \> 0\$, and \$\\beta \> 0\$ - \$\\mu=E(X)=\\frac{\\alpha}{\\alpha+\\beta}\$ - \$\\sigma^2=Var(X)=\\frac{\\alpha\\beta}{(\\alpha+\\beta)^2(\\alpha+\\beta+1)}\$ - \$\\sigma=SD(X)=\\sqrt{\\frac{\\alpha\\beta}{(\\alpha+\\beta)^2(\\alpha+\\beta+1)}}\$
Shard	115 (laksa)
Root Hash	15749649359141072315
Unparsed URL	edu,uiowa!divms,homepage,/~mbognar/applets/beta.html s443