🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 108 (from laksa139)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa108.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://anonymous.4open.science/\')), getAhrefsUnparsedNoserviceFromURL(\'https://anonymous.4open.science/\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/anonymous.4open.science\/","crawl_time":1776147262,"first_indexed_time":1536163204,"http_code":200,"src_unparsed":"science,4open!anonymous,\/ s443","src_root_hash":"15291157651673761108","history_drop_reason":null,"meta_title":"Anonymous GitHub","meta_descriptions":[],"attrs_boilerpipe_text":"Double-anonymous\nAnonymize your repositories.\nAnonymous Github allows you to simply anonymize your Github\n            repository. Several anonymization options are available to ensure\n            that you do not break the double-anonymize such as removing links,\n            images or specific terms. You still keep control of your repository,\n            define an expiration date to make your repository unavailable after\n            the review.\nExplorer\nNavigate the content.\nThe reviewers can explore your repository with ease, the source code\n            is highlighted, PDFs, images, Notebook are rendered. The goal is to\n            make is as easy as possible for the reviewer to explore and review\n            the repository.\nGitHub Pages\nis also supported, but not static site generators, such as Jekyll.\nManage\nKeep an eyes on your repositories.\nKeep a view in your anonymized repositories. Edit your anonymization\n            configuration, remove your repository and update the content of your\n            repository. You can also monitor the access and the number of views\n            of your repository.\nMetrics","attrs_markdown":"[Anonymous GitHub](https:\/\/anonymous.4open.science\/)\n\n- [Home](https:\/\/anonymous.4open.science\/)\n\n- [FAQ](https:\/\/anonymous.4open.science\/faq)\n- [Report an issue](https:\/\/github.com\/tdurieux\/anonymous_github\/issues\/new)\n- [Dark Mode](https:\/\/anonymous.4open.science\/)\n- [Login](https:\/\/anonymous.4open.science\/github\/login)\n\n## Usage\n1. [Login](https:\/\/anonymous.4open.science\/github\/login) with Github access your dashboard and anonymize your repositories.\n2. Complete the list of terms that will be anonymized.\n3. Anonymize and share your link in your double-anonymized paper.\n\nExample of an anonymized repository: <https:\/\/anonymous.4open.science\/r\/840c8c57-3c32-451e-bf12-0e20be300389\/>.\n***\n## Double-anonymous Anonymize your repositories.\nAnonymous Github allows you to simply anonymize your Github repository. Several anonymization options are available to ensure that you do not break the double-anonymize such as removing links, images or specific terms. You still keep control of your repository, define an expiration date to make your repository unavailable after the review.\n\n![](https:\/\/anonymous.4open.science\/imgs\/anonymize.png)\n***\n## Explorer Navigate the content.\nThe reviewers can explore your repository with ease, the source code is highlighted, PDFs, images, Notebook are rendered. The goal is to make is as easy as possible for the reviewer to explore and review the repository. [GitHub Pages](https:\/\/pages.github.com\/) is also supported, but not static site generators, such as Jekyll.\n\n![](https:\/\/anonymous.4open.science\/imgs\/explorer.png)\n***\n## Manage Keep an eyes on your repositories.\nKeep a view in your anonymized repositories. Edit your anonymization configuration, remove your repository and update the content of your repository. You can also monitor the access and the number of views of your repository.\n\n![](https:\/\/anonymous.4open.science\/imgs\/dashboard.png)\n***\n## Metrics\n### 73,578 Users\n### 200,065 Repositories\n### 8,999,856 Page views\n\n[ko-fi.com\/tdurieux](https:\/\/ko-fi.com\/tdurieux)\n\n[ko-fi.com\/tdurieux](https:\/\/ko-fi.com\/tdurieux)","attrs_readable_markdown":"***\n## Double-anonymous Anonymize your repositories.\nAnonymous Github allows you to simply anonymize your Github repository. Several anonymization options are available to ensure that you do not break the double-anonymize such as removing links, images or specific terms. You still keep control of your repository, define an expiration date to make your repository unavailable after the review.\n\n![](https:\/\/anonymous.4open.science\/imgs\/anonymize.png)\n***\n## Explorer Navigate the content.\nThe reviewers can explore your repository with ease, the source code is highlighted, PDFs, images, Notebook are rendered. The goal is to make is as easy as possible for the reviewer to explore and review the repository. [GitHub Pages](https:\/\/pages.github.com\/) is also supported, but not static site generators, such as Jekyll.\n\n![](https:\/\/anonymous.4open.science\/imgs\/explorer.png)\n***\n## Manage Keep an eyes on your repositories.\nKeep a view in your anonymized repositories. Edit your anonymization configuration, remove your repository and update the content of your repository. You can also monitor the access and the number of views of your repository.\n\n![](https:\/\/anonymous.4open.science\/imgs\/dashboard.png)\n***\n## Metrics","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

4 hours ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://anonymous.4open.science/
Last Crawled	2026-04-14 06:14:22 (4 hours ago)
First Indexed	2018-09-05 16:00:04 (7 years ago)
HTTP Status Code	200
Meta Title	Anonymous GitHub
Meta Description	null
Meta Canonical	null
Boilerpipe Text	Double-anonymous Anonymize your repositories. Anonymous Github allows you to simply anonymize your Github repository. Several anonymization options are available to ensure that you do not break the double-anonymize such as removing links, images or specific terms. You still keep control of your repository, define an expiration date to make your repository unavailable after the review. Explorer Navigate the content. The reviewers can explore your repository with ease, the source code is highlighted, PDFs, images, Notebook are rendered. The goal is to make is as easy as possible for the reviewer to explore and review the repository. GitHub Pages is also supported, but not static site generators, such as Jekyll. Manage Keep an eyes on your repositories. Keep a view in your anonymized repositories. Edit your anonymization configuration, remove your repository and update the content of your repository. You can also monitor the access and the number of views of your repository. Metrics
Markdown	[Anonymous GitHub](https://anonymous.4open.science/) - [Home](https://anonymous.4open.science/) - [FAQ](https://anonymous.4open.science/faq) - [Report an issue](https://github.com/tdurieux/anonymous_github/issues/new) - [Dark Mode](https://anonymous.4open.science/) - [Login](https://anonymous.4open.science/github/login) ## Usage 1. [Login](https://anonymous.4open.science/github/login) with Github access your dashboard and anonymize your repositories. 2. Complete the list of terms that will be anonymized. 3. Anonymize and share your link in your double-anonymized paper. Example of an anonymized repository: <https://anonymous.4open.science/r/840c8c57-3c32-451e-bf12-0e20be300389/>. * ## Double-anonymous Anonymize your repositories. Anonymous Github allows you to simply anonymize your Github repository. Several anonymization options are available to ensure that you do not break the double-anonymize such as removing links, images or specific terms. You still keep control of your repository, define an expiration date to make your repository unavailable after the review. ![](https://anonymous.4open.science/imgs/anonymize.png) * ## Explorer Navigate the content. The reviewers can explore your repository with ease, the source code is highlighted, PDFs, images, Notebook are rendered. The goal is to make is as easy as possible for the reviewer to explore and review the repository. [GitHub Pages](https://pages.github.com/) is also supported, but not static site generators, such as Jekyll. ![](https://anonymous.4open.science/imgs/explorer.png) * ## Manage Keep an eyes on your repositories. Keep a view in your anonymized repositories. Edit your anonymization configuration, remove your repository and update the content of your repository. You can also monitor the access and the number of views of your repository. ![](https://anonymous.4open.science/imgs/dashboard.png) * ## Metrics ### 73,578 Users ### 200,065 Repositories ### 8,999,856 Page views [ko-fi.com/tdurieux](https://ko-fi.com/tdurieux) [ko-fi.com/tdurieux](https://ko-fi.com/tdurieux)
Readable Markdown	* ## Double-anonymous Anonymize your repositories. Anonymous Github allows you to simply anonymize your Github repository. Several anonymization options are available to ensure that you do not break the double-anonymize such as removing links, images or specific terms. You still keep control of your repository, define an expiration date to make your repository unavailable after the review. ![](https://anonymous.4open.science/imgs/anonymize.png) * ## Explorer Navigate the content. The reviewers can explore your repository with ease, the source code is highlighted, PDFs, images, Notebook are rendered. The goal is to make is as easy as possible for the reviewer to explore and review the repository. [GitHub Pages](https://pages.github.com/) is also supported, but not static site generators, such as Jekyll. ![](https://anonymous.4open.science/imgs/explorer.png) * ## Manage Keep an eyes on your repositories. Keep a view in your anonymized repositories. Edit your anonymization configuration, remove your repository and update the content of your repository. You can also monitor the access and the number of views of your repository. ![](https://anonymous.4open.science/imgs/dashboard.png) * ## Metrics
Shard	108 (laksa)
Root Hash	15291157651673761108
Unparsed URL	science,4open!anonymous,/ s443