đŸ•ˇī¸ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 59 (from laksa102)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

â„šī¸ Skipped - page is already crawled

đŸšĢ
NOT INDEXABLE
✅
CRAWLED
9 months ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusFAILdownload_http_code = 200HTTP 403
Age cutoffFAILdownload_stamp > now() - 6 MONTH9.1 months ago
History dropFAILisNull(history_drop_reason)oldunavailable
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0

Page Details

PropertyValue
URLhttps://mediaspace.baylor.edu/media/Beta+Distribution/1_r7o1ohed
Last Crawled2025-05-30 09:36:20 (9 months ago)
HTTP Status Code403
Shard59 (laksa)
Root Hash8121375181043003459
Unparsed URLedu,baylor!mediaspace,/media/Beta+Distribution/1_r7o1ohed s443