🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 38 (from laksa033)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa038.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://anaconda.org/anaconda/python\')), getAhrefsUnparsedNoserviceFromURL(\'https://anaconda.org/anaconda/python\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/anaconda.org\/anaconda\/python","crawl_time":1775944943,"first_indexed_time":1454331728,"http_code":200,"src_unparsed":"org,anaconda!\/anaconda\/python s443","src_root_hash":"12808348898462726638","history_drop_reason":null,"meta_title":"python - anaconda | Anaconda.org","meta_descriptions":["Install python with Anaconda.org. General purpose programming language"],"attrs_boilerpipe_text":"Versions\n3.14.3\nTo install this package, run one of the following:\n$\nconda install anaconda::python\nVersion\n3.14.3\n3.14.2\n3.14.1\n3.14.0\n3.13.12\n5 \/ 8 versions selected\nDownloads (Last 6 months): 5.4K\nPython is a widely used high-level, general-purpose, interpreted, dynamic\nprogramming language. Its design philosophy emphasizes code\nreadability, and its syntax allows programmers to express concepts in\nfewer lines of code than would be possible in languages such as C++ or\nJava. The language provides constructs intended to enable clear programs\non both a small and large scale.\nSummary\nGeneral purpose programming language\nLast Updated\nFeb 25, 2026 at 01:22\nLicense\nPSF-2.0\nTotal Downloads\n14.9M\nVersion Downloads\n1.9K\nSupported Platforms\nmacOS-arm64\nlinux-64\nlinux-aarch64\nwin-64\nUnsupported Platforms\nlinux-ppc64le\nLast supported version: 3.12.0\nwin-32\nLast supported version: 3.10.4\nlinux-s390x\nLast supported version: 3.13.2\nmacOS-64\nLast supported version: 3.13.5\nlinux-32\nLast supported version: 3.7.1","attrs_markdown":"[![Anaconda Logo](https:\/\/anaconda.org\/anaconda\/images\/anaconda_org_logo.svg)](https:\/\/anaconda.org\/)\n\nCTRL + K\n\nSign In\n\nSign Up\n\nWe are releasing a new user experience! Be aware that these rolling changes are ongoing and some pages will still have the old user interface.\n\nJoin Paid Research Study\n\n[anaconda](https:\/\/anaconda.org\/anaconda)\/python\n\n### python\nCommunity\n\nGeneral purpose programming language\n\n- [Overview](https:\/\/anaconda.org\/channels\/anaconda\/packages\/python\/overview)\n- [Files 1385](https:\/\/anaconda.org\/channels\/anaconda\/packages\/python\/files)\n- [Labels 1](https:\/\/anaconda.org\/channels\/anaconda\/packages\/python\/labels)\n- [Badges](https:\/\/anaconda.org\/anaconda\/python\/badges)\n\nVersions\n\n3\\.14.3\n\n#### Installation\nTo install this package, run one of the following:\n\n##### Conda\n\\$`conda install anaconda::python`\n\n#### Usage Tracking\nMonthly\n\nDownloads\n\nUpdates\n\nVersion\n\n3\\.14.3\n\n3\\.14.2\n\n3\\.14.1\n\n3\\.14.0\n\n3\\.13.12\n\n5 \/ 8 versions selected\n\nDownloads (Last 6 months): 5.4K\n\nNov 2025\n\nDec 2025\n\nJan 2026\n\nFeb 2026\n\nMar 2026\n\nApr 2026\n\n0\n\n200\n\n400\n\n600\n\n800\n\n1\\.0K\n\n1\\.2K\n\n1\\.4K\n\n1\\.6K\n\nDownload Count\n\n3\\.14.3\n\n3\\.14.2\n\n3\\.14.1\n\n3\\.14.0\n\n3\\.13.12\n\nNo data available for the selected options\n\n#### Description\nPython is a widely used high-level, general-purpose, interpreted, dynamic programming language. Its design philosophy emphasizes code readability, and its syntax allows programmers to express concepts in fewer lines of code than would be possible in languages such as C++ or Java. The language provides constructs intended to enable clear programs on both a small and large scale.\n\n#### About\nSummary\n\nGeneral purpose programming language\n\nLast Updated\n\nFeb 25, 2026 at 01:22\n\nLicense\n\nPSF-2.0\n\nTotal Downloads\n\n14\\.9M\n\nVersion Downloads\n\n1\\.9K\n\nSupported Platforms\n\nmacOS-arm64\n\nlinux-64\n\nlinux-aarch64\n\nwin-64\n\nUnsupported Platforms\n\nlinux-ppc64le Last supported version: 3.12.0\n\nwin-32 Last supported version: 3.10.4\n\nlinux-s390x Last supported version: 3.13.2\n\nmacOS-64 Last supported version: 3.13.5\n\nlinux-32 Last supported version: 3.7.1\n\nHome\n\n<https:\/\/www.python.org\/>\n\nGitHub Repository\n\n<https:\/\/devguide.python.org\/>\n\nDocumentation\n\n<https:\/\/www.python.org\/doc\/versions\/>","attrs_readable_markdown":"Versions3\\.14.3\n\nTo install this package, run one of the following:\n\n\\$`conda install anaconda::python`\n\nVersion\n\n3\\.14.3\n\n3\\.14.2\n\n3\\.14.1\n\n3\\.14.0\n\n3\\.13.12\n\n5 \/ 8 versions selected\n\nDownloads (Last 6 months): 5.4K\n\nPython is a widely used high-level, general-purpose, interpreted, dynamic programming language. Its design philosophy emphasizes code readability, and its syntax allows programmers to express concepts in fewer lines of code than would be possible in languages such as C++ or Java. The language provides constructs intended to enable clear programs on both a small and large scale.\n\nSummary\n\nGeneral purpose programming language\n\nLast Updated\n\nFeb 25, 2026 at 01:22\n\nLicense\n\nPSF-2.0\n\nTotal Downloads\n\n14\\.9M\n\nVersion Downloads\n\n1\\.9K\n\nSupported Platforms\n\nmacOS-arm64\n\nlinux-64\n\nlinux-aarch64\n\nwin-64\n\nUnsupported Platforms\n\nlinux-ppc64le Last supported version: 3.12.0\n\nwin-32 Last supported version: 3.10.4\n\nlinux-s390x Last supported version: 3.13.2\n\nmacOS-64 Last supported version: 3.13.5\n\nlinux-32 Last supported version: 3.7.1","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

1 day ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0.1 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://anaconda.org/anaconda/python
Last Crawled	2026-04-11 22:02:23 (1 day ago)
First Indexed	2016-02-01 13:02:08 (10 years ago)
HTTP Status Code	200
Meta Title	python - anaconda \| Anaconda.org
Meta Description	Install python with Anaconda.org. General purpose programming language
Meta Canonical	null
Boilerpipe Text	Versions 3.14.3 To install this package, run one of the following: $ conda install anaconda::python Version 3.14.3 3.14.2 3.14.1 3.14.0 3.13.12 5 / 8 versions selected Downloads (Last 6 months): 5.4K Python is a widely used high-level, general-purpose, interpreted, dynamic programming language. Its design philosophy emphasizes code readability, and its syntax allows programmers to express concepts in fewer lines of code than would be possible in languages such as C++ or Java. The language provides constructs intended to enable clear programs on both a small and large scale. Summary General purpose programming language Last Updated Feb 25, 2026 at 01:22 License PSF-2.0 Total Downloads 14.9M Version Downloads 1.9K Supported Platforms macOS-arm64 linux-64 linux-aarch64 win-64 Unsupported Platforms linux-ppc64le Last supported version: 3.12.0 win-32 Last supported version: 3.10.4 linux-s390x Last supported version: 3.13.2 macOS-64 Last supported version: 3.13.5 linux-32 Last supported version: 3.7.1
Markdown	[![Anaconda Logo](https://anaconda.org/anaconda/images/anaconda_org_logo.svg)](https://anaconda.org/) CTRL + K Sign In Sign Up We are releasing a new user experience! Be aware that these rolling changes are ongoing and some pages will still have the old user interface. Join Paid Research Study [anaconda](https://anaconda.org/anaconda)/python ### python Community General purpose programming language - [Overview](https://anaconda.org/channels/anaconda/packages/python/overview) - [Files 1385](https://anaconda.org/channels/anaconda/packages/python/files) - [Labels 1](https://anaconda.org/channels/anaconda/packages/python/labels) - [Badges](https://anaconda.org/anaconda/python/badges) Versions 3\.14.3 #### Installation To install this package, run one of the following: ##### Conda \$`conda install anaconda::python` #### Usage Tracking Monthly Downloads Updates Version 3\.14.3 3\.14.2 3\.14.1 3\.14.0 3\.13.12 5 / 8 versions selected Downloads (Last 6 months): 5.4K Nov 2025 Dec 2025 Jan 2026 Feb 2026 Mar 2026 Apr 2026 0 200 400 600 800 1\.0K 1\.2K 1\.4K 1\.6K Download Count 3\.14.3 3\.14.2 3\.14.1 3\.14.0 3\.13.12 No data available for the selected options #### Description Python is a widely used high-level, general-purpose, interpreted, dynamic programming language. Its design philosophy emphasizes code readability, and its syntax allows programmers to express concepts in fewer lines of code than would be possible in languages such as C++ or Java. The language provides constructs intended to enable clear programs on both a small and large scale. #### About Summary General purpose programming language Last Updated Feb 25, 2026 at 01:22 License PSF-2.0 Total Downloads 14\.9M Version Downloads 1\.9K Supported Platforms macOS-arm64 linux-64 linux-aarch64 win-64 Unsupported Platforms linux-ppc64le Last supported version: 3.12.0 win-32 Last supported version: 3.10.4 linux-s390x Last supported version: 3.13.2 macOS-64 Last supported version: 3.13.5 linux-32 Last supported version: 3.7.1 Home <https://www.python.org/> GitHub Repository <https://devguide.python.org/> Documentation <https://www.python.org/doc/versions/>
Readable Markdown	Versions3\.14.3 To install this package, run one of the following: \$`conda install anaconda::python` Version 3\.14.3 3\.14.2 3\.14.1 3\.14.0 3\.13.12 5 / 8 versions selected Downloads (Last 6 months): 5.4K Python is a widely used high-level, general-purpose, interpreted, dynamic programming language. Its design philosophy emphasizes code readability, and its syntax allows programmers to express concepts in fewer lines of code than would be possible in languages such as C++ or Java. The language provides constructs intended to enable clear programs on both a small and large scale. Summary General purpose programming language Last Updated Feb 25, 2026 at 01:22 License PSF-2.0 Total Downloads 14\.9M Version Downloads 1\.9K Supported Platforms macOS-arm64 linux-64 linux-aarch64 win-64 Unsupported Platforms linux-ppc64le Last supported version: 3.12.0 win-32 Last supported version: 3.10.4 linux-s390x Last supported version: 3.13.2 macOS-64 Last supported version: 3.13.5 linux-32 Last supported version: 3.7.1
Shard	38 (laksa)
Root Hash	12808348898462726638
Unparsed URL	org,anaconda!/anaconda/python s443