🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 33 (from laksa173)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa033.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.neopets.com/login/\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.neopets.com/login/\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.neopets.com\/login\/","crawl_time":1775685700,"first_indexed_time":1399727631,"http_code":200,"src_unparsed":"com,neopets!www,\/login\/ s443","src_root_hash":"6629579207166121433","history_drop_reason":null,"meta_title":"Neopets - Hi!","meta_descriptions":["Neopets.Com - Virtual Pet Community! Join up for free games, shops, auctions, chat and more!"],"attrs_boilerpipe_text":"Neopets Account\nNeoPass\nUsername:\nPassword:\nShow Password\nForgot your\nUsername\nor\nPassword\n?\nDon't have an account?\nRegister with NeoPass!\nTwo-Factor Authentication\nEnter 6-digit code from your authenticator application\nEnter 8-digit emergency backup code\nWARNING!\nThis action will disable 2FA on your account!\nUse\nEmergency Backup\nCode\nDate of Birth Required\nIt looks like you haven't been here in a while!\nFor security purposes, please verify your birthday:\nTwo-Factor Authentication Disabled!\nTwo-Factor Authentication has now been disabled on your account.\nYou will now be redirected to your settings to re-enable 2FA!","attrs_markdown":"### Community\n### Merch\n[Support](https:\/\/support.neopets.com\/)\n\n[Sign-Up](https:\/\/www.neopets.com\/signup\/index.phtml)\n\n[Sign-up](https:\/\/www.neopets.com\/signup\/index.phtml)\n\n[Login](https:\/\/www.neopets.com\/login\/)\n\n- ### Community\n- ### Merch\n- - [Merch Shop](https:\/\/neopetsshop.com\/)\n  - [Merch Partners](https:\/\/www.neopets.com\/login\/shopping\/index.phtml)\n\nNeopets Account\n\nNeoPass\n\n## I HAVE A NEOPASS\nYou will be redirected to the NeoPass site and log in.\n\nLog In With NeoPass\n\n## Recover Username\nEnter your email address and we'll email your username to you.\n\n### Email\nDon't remember your email?\n\n[Contact Customer Support](https:\/\/classic.support.neopets.com\/hc\/en-us\/requests\/new)\n## Recover Username\n\n### Two-Factor Authentication\nEnter 6-digit code from your authenticator application\n\nClear\n\nEnter 8-digit emergency backup code\n\nWARNING\\! This action will disable 2FA on your account\\!\n\nClear\n\nSubmit\n\n[Use Emergency Backup Code](https:\/\/www.neopets.com\/login\/)\n\n### Date of Birth Required\nIt looks like you haven't been here in a while\\!\n\nFor security purposes, please verify your birthday:\n\nSubmit\n\n### Two-Factor Authentication Disabled\\!\nTwo-Factor Authentication has now been disabled on your account.\n\nYou will now be redirected to your settings to re-enable 2FA\\!\n\n[Terms of Use](https:\/\/www.neopets.com\/terms.phtml)\n\n[Privacy Policy](https:\/\/www.neopets.com\/privacy.phtml)\n\n[Support](https:\/\/support.neopets.com\/)\n\nNEOPETS and all related indicia are trademarks of Neopets, Inc., © 1999-2026. ® denotes Reg. USPTO. All rights reserved.","attrs_readable_markdown":"Neopets Account\n\nNeoPass\n\n### Two-Factor Authentication\nEnter 6-digit code from your authenticator application\n\nEnter 8-digit emergency backup code\n\nWARNING\\! This action will disable 2FA on your account\\!\n\n[Use Emergency Backup Code](https:\/\/www.neopets.com\/login\/)\n\n### Date of Birth Required\nIt looks like you haven't been here in a while\\!\n\nFor security purposes, please verify your birthday:\n\nTwo-Factor Authentication Disabled\\!\n\nTwo-Factor Authentication has now been disabled on your account.\n\nYou will now be redirected to your settings to re-enable 2FA\\!","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

3 days ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0.1 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.neopets.com/login/
Last Crawled	2026-04-08 22:01:40 (3 days ago)
First Indexed	2014-05-10 13:13:51 (11 years ago)
HTTP Status Code	200
Meta Title	Neopets - Hi!
Meta Description	Neopets.Com - Virtual Pet Community! Join up for free games, shops, auctions, chat and more!
Meta Canonical	null
Boilerpipe Text	Neopets Account NeoPass Username: Password: Show Password Forgot your Username or Password ? Don't have an account? Register with NeoPass! Two-Factor Authentication Enter 6-digit code from your authenticator application Enter 8-digit emergency backup code WARNING! This action will disable 2FA on your account! Use Emergency Backup Code Date of Birth Required It looks like you haven't been here in a while! For security purposes, please verify your birthday: Two-Factor Authentication Disabled! Two-Factor Authentication has now been disabled on your account. You will now be redirected to your settings to re-enable 2FA!
Markdown	### Community ### Merch [Support](https://support.neopets.com/) [Sign-Up](https://www.neopets.com/signup/index.phtml) [Sign-up](https://www.neopets.com/signup/index.phtml) [Login](https://www.neopets.com/login/) - ### Community - ### Merch - - [Merch Shop](https://neopetsshop.com/) - [Merch Partners](https://www.neopets.com/login/shopping/index.phtml) Neopets Account NeoPass ## I HAVE A NEOPASS You will be redirected to the NeoPass site and log in. Log In With NeoPass ## Recover Username Enter your email address and we'll email your username to you. ### Email Don't remember your email? [Contact Customer Support](https://classic.support.neopets.com/hc/en-us/requests/new) ## Recover Username ### Two-Factor Authentication Enter 6-digit code from your authenticator application Clear Enter 8-digit emergency backup code WARNING\! This action will disable 2FA on your account\! Clear Submit [Use Emergency Backup Code](https://www.neopets.com/login/) ### Date of Birth Required It looks like you haven't been here in a while\! For security purposes, please verify your birthday: Submit ### Two-Factor Authentication Disabled\! Two-Factor Authentication has now been disabled on your account. You will now be redirected to your settings to re-enable 2FA\! [Terms of Use](https://www.neopets.com/terms.phtml) [Privacy Policy](https://www.neopets.com/privacy.phtml) [Support](https://support.neopets.com/) NEOPETS and all related indicia are trademarks of Neopets, Inc., © 1999-2026. ® denotes Reg. USPTO. All rights reserved.
Readable Markdown	Neopets Account NeoPass ### Two-Factor Authentication Enter 6-digit code from your authenticator application Enter 8-digit emergency backup code WARNING\! This action will disable 2FA on your account\! [Use Emergency Backup Code](https://www.neopets.com/login/) ### Date of Birth Required It looks like you haven't been here in a while\! For security purposes, please verify your birthday: Two-Factor Authentication Disabled\! Two-Factor Authentication has now been disabled on your account. You will now be redirected to your settings to re-enable 2FA\!
Shard	33 (laksa)
Root Hash	6629579207166121433
Unparsed URL	com,neopets!www,/login/ s443