đŸ•ˇī¸ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 108 (from laksa190)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

â„šī¸ Skipped - page is already crawled

đŸšĢ
NOT INDEXABLE
✅
CRAWLED
1 year ago
đŸšĢ
ROBOTS BLOCKED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffFAILdownload_stamp > now() - 6 MONTH20.3 months ago
History dropFAILisNull(history_drop_reason)disallowed
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://www.wivb.com/
Last Crawled2024-08-09 03:30:04 (1 year ago)
First Indexed2018-06-18 17:28:12 (7 years ago)
HTTP Status Code200
Meta TitleBuffalo News, Weather & Sports | WIVB News 4
Meta DescriptionWIVB News 4 Buffalo is your source for Western New York's local news, weather and sports. News 4 is here for you with breaking news and weather coverage.
Meta Canonicalnull
Boilerpipe Text
Your Privacy When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings). Privacy laws in certain states (e.g. California, Virginia and others) require companies to allow residents of those states to submit a request for access to or deletion of their personal information. If such privacy laws are applicable to you, you may submit your request here
Markdownnull
Readable Markdownnull
Shard108 (laksa)
Root Hash1981450699923799308
Unparsed URLcom,wivb!www,/ s443