ℹ️ Skipped - page is already crawled
| Filter | Status | Condition | Details |
|---|---|---|---|
| HTTP status | PASS | download_http_code = 200 | HTTP 200 |
| Age cutoff | PASS | download_stamp > now() - 6 MONTH | 0.3 months ago |
| History drop | PASS | isNull(history_drop_reason) | No drop reason |
| Spam/ban | PASS | fh_dont_index != 1 AND ml_spam_score = 0 | ml_spam_score=0 |
| Canonical | PASS | meta_canonical IS NULL OR = '' OR = src_unparsed | Not set |
| Property | Value | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| URL | https://www.screamingfrog.co.uk/seo-spider/ | |||||||||
| Last Crawled | 2026-05-26 05:38:08 (8 days ago) | |||||||||
| First Indexed | 2015-08-05 14:01:44 (10 years ago) | |||||||||
| HTTP Status Code | 200 | |||||||||
| Content | ||||||||||
| Meta Title | Screaming Frog SEO Spider Website Crawler | |||||||||
| Meta Description | The industry leading website crawler for Windows, macOS and Ubuntu, trusted by thousands of SEOs and agencies worldwide for technical SEO site audits. | |||||||||
| Meta Canonical | null | |||||||||
| Boilerpipe Text | heavy column, fetched on demand | |||||||||
| Markdown | heavy column, fetched on demand | |||||||||
| Readable Markdown | heavy column, fetched on demand | |||||||||
| ML Classification | ||||||||||
| ML Categories |
Raw JSON{
"/Internet_and_Telecom": 905,
"/Internet_and_Telecom/Web_Services": 861,
"/Internet_and_Telecom/Web_Services/Search_Engine_Optimization_and_Marketing": 817
} | |||||||||
| ML Page Types |
Raw JSON{
"/Core_Page": 363,
"/Core_Page/Services_Page": 351
} | |||||||||
| ML Intent Types |
Raw JSON{
"Commercial": 617,
"Informational": 467,
"Transactional": 147
} | |||||||||
| Content Metadata | ||||||||||
| Language | en | |||||||||
| Author | null | |||||||||
| Publish Time | 2026-05-20 12:14:10 (14 days ago) | |||||||||
| Original Publish Time | 2015-08-05 14:01:44 (10 years ago) | |||||||||
| Republished | Yes | |||||||||
| Word Count (Total) | 2,862 | |||||||||
| Word Count (Content) | 2,305 | |||||||||
| Links | ||||||||||
| External Links | 12 | |||||||||
| Internal Links | 78 | |||||||||
| Technical SEO | ||||||||||
| Meta Nofollow | No | |||||||||
| Meta Noarchive | No | |||||||||
| JS Rendered | Yes | |||||||||
| Redirect Target | null | |||||||||
| Performance | ||||||||||
| Download Time (ms) | 54 | |||||||||
| TTFB (ms) | 53 | |||||||||
| Download Size (bytes) | 47,299 | |||||||||
| Location | ||||||||||
| Host ID | 111 (laksa111) | |||||||||
| Partition ID | 6 | |||||||||
| Root Hash | 8552685892958341311 | |||||||||
| Unparsed URL | uk,co,screamingfrog!www,/seo-spider/ s443 | |||||||||