🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 170 (from laksa087)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa170.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://beta.goodmorningamerica.com/news/video/neil-armstrong-1st-man-walk-moon-50-years-64458209\')), getAhrefsUnparsedNoserviceFromURL(\'https://beta.goodmorningamerica.com/news/video/neil-armstrong-1st-man-walk-moon-50-years-64458209\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/beta.goodmorningamerica.com\/news\/video\/neil-armstrong-1st-man-walk-moon-50-years-64458209","crawl_time":1745867498,"first_indexed_time":1735913102,"http_code":200,"src_unparsed":"com,goodmorningamerica!beta,\/news\/video\/neil-armstrong-1st-man-walk-moon-50-years-64458209 s443","src_root_hash":"9782075024402792370","history_drop_reason":null,"meta_title":"Neil Armstrong was the 1st man to walk on the moon 50 years ago today - Good Morning America","meta_descriptions":["The world celebrates the 50th anniversary of the historic moon landing of spaceflight Apollo 11, when Armstrong famously declared, \"That's one small step for man, one giant leap for mankind.\""],"attrs_boilerpipe_text":"Neil Armstrong was the 1st man to walk on the moon 50 years ago today - Good Morning America","attrs_markdown":"#\nOpen menu\n\n#\n- [Video](https:\/\/beta.goodmorningamerica.com\/video)\n- [Shop](https:\/\/beta.goodmorningamerica.com\/shop)\n- [Culture](https:\/\/beta.goodmorningamerica.com\/culture)\n- [Family](https:\/\/beta.goodmorningamerica.com\/family)\n- [Wellness](https:\/\/beta.goodmorningamerica.com\/wellness)\n- [Food](https:\/\/beta.goodmorningamerica.com\/food)\n- [Living](https:\/\/beta.goodmorningamerica.com\/living)\n- [Style](https:\/\/beta.goodmorningamerica.com\/style)\n\n- [Travel](https:\/\/beta.goodmorningamerica.com\/travel)\n- [News](https:\/\/beta.goodmorningamerica.com\/news)\n- [Book Club](https:\/\/beta.goodmorningamerica.com\/bookclub)\n- [GMA3: WYNTK](https:\/\/beta.goodmorningamerica.com\/video\/gma3)\n\n- [Newsletter](https:\/\/beta.goodmorningamerica.com\/newsletter)\n\n- [Privacy Policy](https:\/\/privacy.thewaltdisneycompany.com\/en\/)\n- [Your US State Privacy Rights](https:\/\/privacy.thewaltdisneycompany.com\/en\/current-privacy-policy\/your-us-state-privacy-rights\/)\n- [Children's Online Privacy Policy](https:\/\/privacy.thewaltdisneycompany.com\/en\/for-parents\/childrens-online-privacy-policy\/)\n- [Interest-Based Ads](https:\/\/privacy.thewaltdisneycompany.com\/en\/privacy-controls\/online-tracking-and-advertising\/)\n- [Terms of Use](https:\/\/disneytermsofuse.com\/)\n- [Do Not Sell My Info](https:\/\/privacy.thewaltdisneycompany.com\/en\/dnssmpi\/)\n- [Contact Us](http:\/\/abcnews.go.com\/Site\/page?id=3068843)\n- © 2025 ABC News\n\nSearch\n\n![VIDEO: Neil Armstrong was the 1st man to walk on the moon 50 years ago today](data:image\/gif;base64,R0lGODlhAQABAIAAAAAAAP\/\/\/yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)\n\n3:38\n\n- [news](https:\/\/beta.goodmorningamerica.com\/news)\n- July 20, 2019\n# Neil Armstrong was the 1st man to walk on the moon 50 years ago today\nThe world celebrates the 50th anniversary of the historic moon landing of spaceflight Apollo 11, when Armstrong famously declared, \"That's one small step for man, one giant leap for mankind.\"\n\n[Up Next in news](https:\/\/beta.goodmorningamerica.com\/news)\n\n[![Apollo 11: 50 years later ](data:image\/gif;base64,R0lGODlhAQABAIAAAAAAAP\/\/\/yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)Apollo 11: 50 years later July 20, 2019](https:\/\/beta.goodmorningamerica.com\/news\/video\/apollo-11-50-years-64451936)\n\n[![Apollo 11 anniversary: Revisiting the moment Americans landed on the moon ](data:image\/gif;base64,R0lGODlhAQABAIAAAAAAAP\/\/\/yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)Apollo 11 anniversary: Revisiting the moment Americans landed on the moon July 19, 2019](https:\/\/beta.goodmorningamerica.com\/news\/video\/apollo-11-anniversary-revisiting-moment-americans-landed-moon-64434835)\n\n[![Man on the moon 50 years later: Luna 15](data:image\/gif;base64,R0lGODlhAQABAIAAAAAAAP\/\/\/yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)Man on the moon 50 years later: Luna 15 July 17, 2019](https:\/\/beta.goodmorningamerica.com\/news\/video\/man-moon-50-years-luna-15-64404175)\n\n#\nThe latest lifestyle and entertainment news and inspiration for how to live your best life - all from Good Morning America.\n\n- [Contests](https:\/\/www.goodmorningamerica.com\/news\/story\/check-latest-gma-contest-campaigns-54593523)\n- [Terms of Use](https:\/\/disneytermsofuse.com\/)\n- [Privacy Policy](https:\/\/privacy.thewaltdisneycompany.com\/en\/)\n- [Do Not Sell My Info](https:\/\/privacy.thewaltdisneycompany.com\/en\/dnssmpi\/)\n- [Children’s Online Privacy Policy](https:\/\/privacy.thewaltdisneycompany.com\/en\/for-parents\/childrens-online-privacy-policy\/)\n- [Advertise with us](https:\/\/www.disneyadvertising.com\/)\n\n- [Your US State Privacy Rights](https:\/\/privacy.thewaltdisneycompany.com\/en\/current-privacy-policy\/your-us-state-privacy-rights\/)\n- [Interest-Based Ads](https:\/\/privacy.thewaltdisneycompany.com\/en\/privacy-controls\/online-tracking-and-advertising\/)\n- [About Nielsen Measurement](https:\/\/www.nielsen.com\/digitalprivacy)\n- [Press](https:\/\/abcnewspr.tumblr.com\/)\n- [Feedback](http:\/\/abcnews.go.com\/Site\/page?id=3068843)\n\n- [Shop FAQs](https:\/\/support.abc.com\/hc\/en-us\/sections\/25745554343572-Shop-ABC-Good-Morning-America)\n- [ABC News](http:\/\/abcnews.go.com\/)\n- [ABC](http:\/\/abc.go.com\/)\n- [All Videos](https:\/\/beta.goodmorningamerica.com\/video\/all-videos)\n- [All Topics](https:\/\/beta.goodmorningamerica.com\/topics)\n\n- [Sitemap](https:\/\/www.goodmorningamerica.com\/sitemap.xml)\n***\n© 2025 ABC News\n\n- [Privacy Policy](https:\/\/privacy.thewaltdisneycompany.com\/en\/)—\n- [Your US State Privacy Rights](https:\/\/privacy.thewaltdisneycompany.com\/en\/current-privacy-policy\/your-us-state-privacy-rights\/)—\n- [Children's Online Privacy Policy](https:\/\/privacy.thewaltdisneycompany.com\/en\/for-parents\/childrens-online-privacy-policy\/)—\n- [Interest-Based Ads](https:\/\/privacy.thewaltdisneycompany.com\/en\/privacy-controls\/online-tracking-and-advertising\/)—\n- [Terms of Use](https:\/\/disneytermsofuse.com\/)—\n- [Do Not Sell My Info](https:\/\/privacy.thewaltdisneycompany.com\/en\/dnssmpi\/)—\n- [Contact Us](http:\/\/abcnews.go.com\/Site\/page?id=3068843)—\n\n© 2025 ABC News","attrs_readable_markdown":null,"meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

🚫

NOT INDEXABLE

✅

CRAWLED

11 months ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	FAIL	`download_stamp > now() - 6 MONTH`	11.8 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://beta.goodmorningamerica.com/news/video/neil-armstrong-1st-man-walk-moon-50-years-64458209
Last Crawled	2025-04-28 19:11:38 (11 months ago)
First Indexed	2025-01-03 14:05:02 (1 year ago)
HTTP Status Code	200
Meta Title	Neil Armstrong was the 1st man to walk on the moon 50 years ago today - Good Morning America
Meta Description	The world celebrates the 50th anniversary of the historic moon landing of spaceflight Apollo 11, when Armstrong famously declared, "That's one small step for man, one giant leap for mankind."
Meta Canonical	null
Boilerpipe Text	Neil Armstrong was the 1st man to walk on the moon 50 years ago today - Good Morning America
Markdown	# Open menu # - [Video](https://beta.goodmorningamerica.com/video) - [Shop](https://beta.goodmorningamerica.com/shop) - [Culture](https://beta.goodmorningamerica.com/culture) - [Family](https://beta.goodmorningamerica.com/family) - [Wellness](https://beta.goodmorningamerica.com/wellness) - [Food](https://beta.goodmorningamerica.com/food) - [Living](https://beta.goodmorningamerica.com/living) - [Style](https://beta.goodmorningamerica.com/style) - [Travel](https://beta.goodmorningamerica.com/travel) - [News](https://beta.goodmorningamerica.com/news) - [Book Club](https://beta.goodmorningamerica.com/bookclub) - [GMA3: WYNTK](https://beta.goodmorningamerica.com/video/gma3) - [Newsletter](https://beta.goodmorningamerica.com/newsletter) - [Privacy Policy](https://privacy.thewaltdisneycompany.com/en/) - [Your US State Privacy Rights](https://privacy.thewaltdisneycompany.com/en/current-privacy-policy/your-us-state-privacy-rights/) - [Children's Online Privacy Policy](https://privacy.thewaltdisneycompany.com/en/for-parents/childrens-online-privacy-policy/) - [Interest-Based Ads](https://privacy.thewaltdisneycompany.com/en/privacy-controls/online-tracking-and-advertising/) - [Terms of Use](https://disneytermsofuse.com/) - [Do Not Sell My Info](https://privacy.thewaltdisneycompany.com/en/dnssmpi/) - [Contact Us](http://abcnews.go.com/Site/page?id=3068843) - © 2025 ABC News Search ![VIDEO: Neil Armstrong was the 1st man to walk on the moon 50 years ago today](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7) 3:38 - [news](https://beta.goodmorningamerica.com/news) - July 20, 2019 # Neil Armstrong was the 1st man to walk on the moon 50 years ago today The world celebrates the 50th anniversary of the historic moon landing of spaceflight Apollo 11, when Armstrong famously declared, "That's one small step for man, one giant leap for mankind." [Up Next in news](https://beta.goodmorningamerica.com/news) [![Apollo 11: 50 years later ](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)Apollo 11: 50 years later July 20, 2019](https://beta.goodmorningamerica.com/news/video/apollo-11-50-years-64451936) [![Apollo 11 anniversary: Revisiting the moment Americans landed on the moon ](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)Apollo 11 anniversary: Revisiting the moment Americans landed on the moon July 19, 2019](https://beta.goodmorningamerica.com/news/video/apollo-11-anniversary-revisiting-moment-americans-landed-moon-64434835) [![Man on the moon 50 years later: Luna 15](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)Man on the moon 50 years later: Luna 15 July 17, 2019](https://beta.goodmorningamerica.com/news/video/man-moon-50-years-luna-15-64404175) # The latest lifestyle and entertainment news and inspiration for how to live your best life - all from Good Morning America. - [Contests](https://www.goodmorningamerica.com/news/story/check-latest-gma-contest-campaigns-54593523) - [Terms of Use](https://disneytermsofuse.com/) - [Privacy Policy](https://privacy.thewaltdisneycompany.com/en/) - [Do Not Sell My Info](https://privacy.thewaltdisneycompany.com/en/dnssmpi/) - [Children’s Online Privacy Policy](https://privacy.thewaltdisneycompany.com/en/for-parents/childrens-online-privacy-policy/) - [Advertise with us](https://www.disneyadvertising.com/) - [Your US State Privacy Rights](https://privacy.thewaltdisneycompany.com/en/current-privacy-policy/your-us-state-privacy-rights/) - [Interest-Based Ads](https://privacy.thewaltdisneycompany.com/en/privacy-controls/online-tracking-and-advertising/) - [About Nielsen Measurement](https://www.nielsen.com/digitalprivacy) - [Press](https://abcnewspr.tumblr.com/) - [Feedback](http://abcnews.go.com/Site/page?id=3068843) - [Shop FAQs](https://support.abc.com/hc/en-us/sections/25745554343572-Shop-ABC-Good-Morning-America) - [ABC News](http://abcnews.go.com/) - [ABC](http://abc.go.com/) - [All Videos](https://beta.goodmorningamerica.com/video/all-videos) - [All Topics](https://beta.goodmorningamerica.com/topics) - [Sitemap](https://www.goodmorningamerica.com/sitemap.xml) *** © 2025 ABC News - [Privacy Policy](https://privacy.thewaltdisneycompany.com/en/)— - [Your US State Privacy Rights](https://privacy.thewaltdisneycompany.com/en/current-privacy-policy/your-us-state-privacy-rights/)— - [Children's Online Privacy Policy](https://privacy.thewaltdisneycompany.com/en/for-parents/childrens-online-privacy-policy/)— - [Interest-Based Ads](https://privacy.thewaltdisneycompany.com/en/privacy-controls/online-tracking-and-advertising/)— - [Terms of Use](https://disneytermsofuse.com/)— - [Do Not Sell My Info](https://privacy.thewaltdisneycompany.com/en/dnssmpi/)— - [Contact Us](http://abcnews.go.com/Site/page?id=3068843)— © 2025 ABC News
Readable Markdown	null
Shard	170 (laksa)
Root Hash	9782075024402792370
Unparsed URL	com,goodmorningamerica!beta,/news/video/neil-armstrong-1st-man-walk-moon-50-years-64458209 s443