🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 174 (from laksa010)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa174.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://whatsmyip.strath.ac.uk/\')), getAhrefsUnparsedNoserviceFromURL(\'https://whatsmyip.strath.ac.uk/\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/whatsmyip.strath.ac.uk\/","crawl_time":1775031125,"first_indexed_time":1742359292,"http_code":200,"src_unparsed":"uk,ac,strath!whatsmyip,\/ s443","src_root_hash":"12383533991557203374","history_drop_reason":null,"meta_title":"What's My IP?","meta_descriptions":[],"attrs_boilerpipe_text":"Your IP address\n54.39.203.202\n(\nLearn more at whatsmyip.org\n|\nGeo-locate me from iplocation.net\n)\nDNS Hostname\nproxy-ca008-san202.ahrefs.net\nLocation classification\nOff-campus\nBrowser UserAgent\nMozilla\/5.0 (compatible; AhrefsBot\/7.0; +http:\/\/ahrefs.com\/robot\/)\nServer's time\nWed, 01 Apr 2026 08:12:05 +0000\nBrowser's time\nPage Age\n0s","attrs_markdown":"# What's My IP?\n***\n## About your connection\n|   |   |\n|---|---|\n| Your IP address | 54\\.39.203.202  ([Learn more at whatsmyip.org](http:\/\/www.whatsmyip.org\/) \\| [Geo-locate me from iplocation.net](https:\/\/www.iplocation.net\/)) |\n| DNS Hostname | proxy-ca008-san202.ahrefs.net |\n| Location classification | Off-campus |\n| Browser UserAgent | Mozilla\/5.0 (compatible; AhrefsBot\/7.0; +http:\/\/ahrefs.com\/robot\/) |\n| Server's time | Wed, 01 Apr 2026 08:12:05 +0000 |\n| Browser's time |   |\n| Page Age | 0s |\n***\n## Notes\n1. If your \"Location classification\" is Off-campus, then the IP address shown is the 'public IP address', assigned by your ISP:\n   - This public IP address may change regularly, eventually over time, or possibly even never\n   - This public IP address will be usually different to the internal 'private' IP address actually assigned to your device within the local network to which you are connected; the private IP address (usually starting with something like\n     192\\.168\n     ) is not exposed to the Internet - this is called \"Network Address Translation\" (NAT)\n2. If you are testing via one of the campus-based VPN service, the Location classification above will indicate which service, based on the virtual IP address the VPN service has allocated to your client\n3. Depending on the VPN service in use, it might be that only traffic destined for campus destinations will make use of the VPN tunnel; in this circumstance, non-campus websites will see your public IP address as being that assigned by your ISP. You can test what the general Internet thinks your IP address is [here](http:\/\/www.whatsmyip.org\/)\n4. Only IPv4 is supported at this time","attrs_readable_markdown":null,"meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

9 days ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0.3 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://whatsmyip.strath.ac.uk/
Last Crawled	2026-04-01 08:12:05 (9 days ago)
First Indexed	2025-03-19 04:41:32 (1 year ago)
HTTP Status Code	200
Meta Title	What's My IP?
Meta Description	null
Meta Canonical	null
Boilerpipe Text	Your IP address 54.39.203.202 ( Learn more at whatsmyip.org \| Geo-locate me from iplocation.net ) DNS Hostname proxy-ca008-san202.ahrefs.net Location classification Off-campus Browser UserAgent Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) Server's time Wed, 01 Apr 2026 08:12:05 +0000 Browser's time Page Age 0s
Markdown	# What's My IP? * ## About your connection \| \| \| \|---\|---\| \| Your IP address \| 54\.39.203.202 ([Learn more at whatsmyip.org](http://www.whatsmyip.org/) \\| [Geo-locate me from iplocation.net](https://www.iplocation.net/)) \| \| DNS Hostname \| proxy-ca008-san202.ahrefs.net \| \| Location classification \| Off-campus \| \| Browser UserAgent \| Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) \| \| Server's time \| Wed, 01 Apr 2026 08:12:05 +0000 \| \| Browser's time \| \| \| Page Age \| 0s \| * ## Notes 1. If your "Location classification" is Off-campus, then the IP address shown is the 'public IP address', assigned by your ISP: - This public IP address may change regularly, eventually over time, or possibly even never - This public IP address will be usually different to the internal 'private' IP address actually assigned to your device within the local network to which you are connected; the private IP address (usually starting with something like 192\.168 ) is not exposed to the Internet - this is called "Network Address Translation" (NAT) 2. If you are testing via one of the campus-based VPN service, the Location classification above will indicate which service, based on the virtual IP address the VPN service has allocated to your client 3. Depending on the VPN service in use, it might be that only traffic destined for campus destinations will make use of the VPN tunnel; in this circumstance, non-campus websites will see your public IP address as being that assigned by your ISP. You can test what the general Internet thinks your IP address is [here](http://www.whatsmyip.org/) 4. Only IPv4 is supported at this time
Readable Markdown	null
Shard	174 (laksa)
Root Hash	12383533991557203374
Unparsed URL	uk,ac,strath!whatsmyip,/ s443