🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 63 (from laksa177)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa063.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://nftrmarketplace.com/\')), getAhrefsUnparsedNoserviceFromURL(\'https://nftrmarketplace.com/\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/nftrmarketplace.com\/","crawl_time":1776075903,"first_indexed_time":1720248132,"http_code":200,"src_unparsed":"com,nftrmarketplace!\/ s443","src_root_hash":"8746052268366690063","history_drop_reason":null,"meta_title":"Index of \/","meta_descriptions":[],"attrs_boilerpipe_text":" \nName\nLast modified\nSize\nDescription\n \nauction.nftrmarketpl..>\n2024-01-30 23:37\n-\n \n \nbower.json\n2023-03-15 08:02\n587\n \n \nbuild-old\/\n2024-03-25 03:56\n-\n \n \nbuild.zip\n2025-01-11 12:58\n18M\n \n \nbuild\/\n2025-01-12 02:47\n-\n \n \nbuild_\/\n2024-12-02 11:08\n-\n \n \ndev.nftrmarketplace...>\n2024-02-05 23:37\n-\n \n \nfrontend.sh\n2024-04-04 01:38\n64\n \n \njsconfig.json\n2023-12-09 16:27\n107\n \n \nnftrmarketplace.apk\n2024-07-07 05:27\n60M\n \n \nnode_modules\/\n2024-01-04 01:24\n-\n \n \npackage-lock.json\n2024-01-04 01:24\n973K\n \n \npackage.json\n2024-03-18 21:34\n3.0K\n \n \npm2.config.js\n2023-12-10 06:32\n278\n \n \npublic\/\n2024-01-08 14:22\n-\n \n \nwallet.nftrmarketpla..>\n2024-03-21 22:23\n-\n \n \nwebpack.config.js\n2023-12-18 21:46\n371\n ","attrs_markdown":"# Index of \/\n|   | [Name](https:\/\/nftrmarketplace.com\/?C=N;O=D) | [Last modified](https:\/\/nftrmarketplace.com\/?C=M;O=A) | [Size](https:\/\/nftrmarketplace.com\/?C=S;O=A) | [Description](https:\/\/nftrmarketplace.com\/?C=D;O=A) |\n|---|---|---|---|---|\n|   | [auction.nftrmarketpl..\\>](https:\/\/nftrmarketplace.com\/auction.nftrmarketplace.com\/) | 2024-01-30 23:37 | \\- |   |\n|   | [bower.json](https:\/\/nftrmarketplace.com\/bower.json) | 2023-03-15 08:02 | 587 |   |\n|   | [build-old\/](https:\/\/nftrmarketplace.com\/build-old\/) | 2024-03-25 03:56 | \\- |   |\n|   | [build.zip](https:\/\/nftrmarketplace.com\/build.zip) | 2025-01-11 12:58 | 18M |   |\n|   | [build\/](https:\/\/nftrmarketplace.com\/build\/) | 2025-01-12 02:47 | \\- |   |\n|   | [build\\_\/](https:\/\/nftrmarketplace.com\/build_\/) | 2024-12-02 11:08 | \\- |   |\n|   | [dev.nftrmarketplace...\\>](https:\/\/nftrmarketplace.com\/dev.nftrmarketplace.com\/) | 2024-02-05 23:37 | \\- |   |\n|   | [frontend.sh](https:\/\/nftrmarketplace.com\/frontend.sh) | 2024-04-04 01:38 | 64 |   |\n|   | [jsconfig.json](https:\/\/nftrmarketplace.com\/jsconfig.json) | 2023-12-09 16:27 | 107 |   |\n|   | [nftrmarketplace.apk](https:\/\/nftrmarketplace.com\/nftrmarketplace.apk) | 2024-07-07 05:27 | 60M |   |\n|   | [node\\_modules\/](https:\/\/nftrmarketplace.com\/node_modules\/) | 2024-01-04 01:24 | \\- |   |\n|   | [package-lock.json](https:\/\/nftrmarketplace.com\/package-lock.json) | 2024-01-04 01:24 | 973K |   |\n|   | [package.json](https:\/\/nftrmarketplace.com\/package.json) | 2024-03-18 21:34 | 3\\.0K |   |\n|   | [pm2.config.js](https:\/\/nftrmarketplace.com\/pm2.config.js) | 2023-12-10 06:32 | 278 |   |\n|   | [public\/](https:\/\/nftrmarketplace.com\/public\/) | 2024-01-08 14:22 | \\- |   |\n|   | [wallet.nftrmarketpla..\\>](https:\/\/nftrmarketplace.com\/wallet.nftrmarketplace.com\/) | 2024-03-21 22:23 | \\- |   |\n|   | [webpack.config.js](https:\/\/nftrmarketplace.com\/webpack.config.js) | 2023-12-18 21:46 | 371 |   |","attrs_readable_markdown":"|   | [Name](https:\/\/nftrmarketplace.com\/?C=N;O=D) | [Last modified](https:\/\/nftrmarketplace.com\/?C=M;O=A) | [Size](https:\/\/nftrmarketplace.com\/?C=S;O=A) | [Description](https:\/\/nftrmarketplace.com\/?C=D;O=A) |\n|---|---|---|---|---|\n|   | [auction.nftrmarketpl..\\>](https:\/\/nftrmarketplace.com\/auction.nftrmarketplace.com\/) | 2024-01-30 23:37 | \\- |   |\n|   | [bower.json](https:\/\/nftrmarketplace.com\/bower.json) | 2023-03-15 08:02 | 587 |   |\n|   | [build-old\/](https:\/\/nftrmarketplace.com\/build-old\/) | 2024-03-25 03:56 | \\- |   |\n|   | [build.zip](https:\/\/nftrmarketplace.com\/build.zip) | 2025-01-11 12:58 | 18M |   |\n|   | [build\/](https:\/\/nftrmarketplace.com\/build\/) | 2025-01-12 02:47 | \\- |   |\n|   | [build\\_\/](https:\/\/nftrmarketplace.com\/build_\/) | 2024-12-02 11:08 | \\- |   |\n|   | [dev.nftrmarketplace...\\>](https:\/\/nftrmarketplace.com\/dev.nftrmarketplace.com\/) | 2024-02-05 23:37 | \\- |   |\n|   | [frontend.sh](https:\/\/nftrmarketplace.com\/frontend.sh) | 2024-04-04 01:38 | 64 |   |\n|   | [jsconfig.json](https:\/\/nftrmarketplace.com\/jsconfig.json) | 2023-12-09 16:27 | 107 |   |\n|   | [nftrmarketplace.apk](https:\/\/nftrmarketplace.com\/nftrmarketplace.apk) | 2024-07-07 05:27 | 60M |   |\n|   | [node\\_modules\/](https:\/\/nftrmarketplace.com\/node_modules\/) | 2024-01-04 01:24 | \\- |   |\n|   | [package-lock.json](https:\/\/nftrmarketplace.com\/package-lock.json) | 2024-01-04 01:24 | 973K |   |\n|   | [package.json](https:\/\/nftrmarketplace.com\/package.json) | 2024-03-18 21:34 | 3\\.0K |   |\n|   | [pm2.config.js](https:\/\/nftrmarketplace.com\/pm2.config.js) | 2023-12-10 06:32 | 278 |   |\n|   | [public\/](https:\/\/nftrmarketplace.com\/public\/) | 2024-01-08 14:22 | \\- |   |\n|   | [wallet.nftrmarketpla..\\>](https:\/\/nftrmarketplace.com\/wallet.nftrmarketplace.com\/) | 2024-03-21 22:23 | \\- |   |\n|   | [webpack.config.js](https:\/\/nftrmarketplace.com\/webpack.config.js) | 2023-12-18 21:46 | 371 |   |","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

21 hours ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://nftrmarketplace.com/
Last Crawled	2026-04-13 10:25:03 (21 hours ago)
First Indexed	2024-07-06 06:42:12 (1 year ago)
HTTP Status Code	200
Meta Title	Index of /
Meta Description	null
Meta Canonical	null
Boilerpipe Text	Name Last modified Size Description auction.nftrmarketpl..> 2024-01-30 23:37 - bower.json 2023-03-15 08:02 587 build-old/ 2024-03-25 03:56 - build.zip 2025-01-11 12:58 18M build/ 2025-01-12 02:47 - build_/ 2024-12-02 11:08 - dev.nftrmarketplace...> 2024-02-05 23:37 - frontend.sh 2024-04-04 01:38 64 jsconfig.json 2023-12-09 16:27 107 nftrmarketplace.apk 2024-07-07 05:27 60M node_modules/ 2024-01-04 01:24 - package-lock.json 2024-01-04 01:24 973K package.json 2024-03-18 21:34 3.0K pm2.config.js 2023-12-10 06:32 278 public/ 2024-01-08 14:22 - wallet.nftrmarketpla..> 2024-03-21 22:23 - webpack.config.js 2023-12-18 21:46 371
Markdown	# Index of / \| \| [Name](https://nftrmarketplace.com/?C=N;O=D) \| [Last modified](https://nftrmarketplace.com/?C=M;O=A) \| [Size](https://nftrmarketplace.com/?C=S;O=A) \| [Description](https://nftrmarketplace.com/?C=D;O=A) \| \|---\|---\|---\|---\|---\| \| \| [auction.nftrmarketpl..\>](https://nftrmarketplace.com/auction.nftrmarketplace.com/) \| 2024-01-30 23:37 \| \- \| \| \| \| [bower.json](https://nftrmarketplace.com/bower.json) \| 2023-03-15 08:02 \| 587 \| \| \| \| [build-old/](https://nftrmarketplace.com/build-old/) \| 2024-03-25 03:56 \| \- \| \| \| \| [build.zip](https://nftrmarketplace.com/build.zip) \| 2025-01-11 12:58 \| 18M \| \| \| \| [build/](https://nftrmarketplace.com/build/) \| 2025-01-12 02:47 \| \- \| \| \| \| [build\_/](https://nftrmarketplace.com/build_/) \| 2024-12-02 11:08 \| \- \| \| \| \| [dev.nftrmarketplace...\>](https://nftrmarketplace.com/dev.nftrmarketplace.com/) \| 2024-02-05 23:37 \| \- \| \| \| \| [frontend.sh](https://nftrmarketplace.com/frontend.sh) \| 2024-04-04 01:38 \| 64 \| \| \| \| [jsconfig.json](https://nftrmarketplace.com/jsconfig.json) \| 2023-12-09 16:27 \| 107 \| \| \| \| [nftrmarketplace.apk](https://nftrmarketplace.com/nftrmarketplace.apk) \| 2024-07-07 05:27 \| 60M \| \| \| \| [node\_modules/](https://nftrmarketplace.com/node_modules/) \| 2024-01-04 01:24 \| \- \| \| \| \| [package-lock.json](https://nftrmarketplace.com/package-lock.json) \| 2024-01-04 01:24 \| 973K \| \| \| \| [package.json](https://nftrmarketplace.com/package.json) \| 2024-03-18 21:34 \| 3\.0K \| \| \| \| [pm2.config.js](https://nftrmarketplace.com/pm2.config.js) \| 2023-12-10 06:32 \| 278 \| \| \| \| [public/](https://nftrmarketplace.com/public/) \| 2024-01-08 14:22 \| \- \| \| \| \| [wallet.nftrmarketpla..\>](https://nftrmarketplace.com/wallet.nftrmarketplace.com/) \| 2024-03-21 22:23 \| \- \| \| \| \| [webpack.config.js](https://nftrmarketplace.com/webpack.config.js) \| 2023-12-18 21:46 \| 371 \| \|
Readable Markdown	\| \| [Name](https://nftrmarketplace.com/?C=N;O=D) \| [Last modified](https://nftrmarketplace.com/?C=M;O=A) \| [Size](https://nftrmarketplace.com/?C=S;O=A) \| [Description](https://nftrmarketplace.com/?C=D;O=A) \| \|---\|---\|---\|---\|---\| \| \| [auction.nftrmarketpl..\>](https://nftrmarketplace.com/auction.nftrmarketplace.com/) \| 2024-01-30 23:37 \| \- \| \| \| \| [bower.json](https://nftrmarketplace.com/bower.json) \| 2023-03-15 08:02 \| 587 \| \| \| \| [build-old/](https://nftrmarketplace.com/build-old/) \| 2024-03-25 03:56 \| \- \| \| \| \| [build.zip](https://nftrmarketplace.com/build.zip) \| 2025-01-11 12:58 \| 18M \| \| \| \| [build/](https://nftrmarketplace.com/build/) \| 2025-01-12 02:47 \| \- \| \| \| \| [build\_/](https://nftrmarketplace.com/build_/) \| 2024-12-02 11:08 \| \- \| \| \| \| [dev.nftrmarketplace...\>](https://nftrmarketplace.com/dev.nftrmarketplace.com/) \| 2024-02-05 23:37 \| \- \| \| \| \| [frontend.sh](https://nftrmarketplace.com/frontend.sh) \| 2024-04-04 01:38 \| 64 \| \| \| \| [jsconfig.json](https://nftrmarketplace.com/jsconfig.json) \| 2023-12-09 16:27 \| 107 \| \| \| \| [nftrmarketplace.apk](https://nftrmarketplace.com/nftrmarketplace.apk) \| 2024-07-07 05:27 \| 60M \| \| \| \| [node\_modules/](https://nftrmarketplace.com/node_modules/) \| 2024-01-04 01:24 \| \- \| \| \| \| [package-lock.json](https://nftrmarketplace.com/package-lock.json) \| 2024-01-04 01:24 \| 973K \| \| \| \| [package.json](https://nftrmarketplace.com/package.json) \| 2024-03-18 21:34 \| 3\.0K \| \| \| \| [pm2.config.js](https://nftrmarketplace.com/pm2.config.js) \| 2023-12-10 06:32 \| 278 \| \| \| \| [public/](https://nftrmarketplace.com/public/) \| 2024-01-08 14:22 \| \- \| \| \| \| [wallet.nftrmarketpla..\>](https://nftrmarketplace.com/wallet.nftrmarketplace.com/) \| 2024-03-21 22:23 \| \- \| \| \| \| [webpack.config.js](https://nftrmarketplace.com/webpack.config.js) \| 2023-12-18 21:46 \| 371 \| \|
Shard	63 (laksa)
Root Hash	8746052268366690063
Unparsed URL	com,nftrmarketplace!/ s443