🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 143 (from laksa049)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa143.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://neo4j-contrib.github.io/neo4j-apoc-procedures/3.5/database-integration/mongodb/\')), getAhrefsUnparsedNoserviceFromURL(\'https://neo4j-contrib.github.io/neo4j-apoc-procedures/3.5/database-integration/mongodb/\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/neo4j-contrib.github.io\/neo4j-apoc-procedures\/3.5\/database-integration\/mongodb\/","crawl_time":1775250479,"first_indexed_time":1552302141,"http_code":200,"src_unparsed":"io,github!neo4j-contrib,\/neo4j-apoc-procedures\/3.5\/database-integration\/mongodb\/ s443","src_root_hash":"2566890010099092343","history_drop_reason":null,"meta_title":"8.4. Interacting with MongoDB - Chapter 8. Database Integration","meta_descriptions":[],"attrs_boilerpipe_text":"Operations Manual\nDeveloper Manual\nOGM Manual\nGraph Algorithms\nAPOC\nJava Reference\nCALL apoc.mongodb.get(host-or-port,db-or-null,collection-or-null,query-or-null,[compatibleValues=true|false],skip-or-null,limit-or-null)\n                                 yield value\nperform a find operation on mongodb collection\nCALL apoc.mongodb.count(host-or-port,db-or-null,collection-or-null,query-or-null) yield value\nperform a find operation on mongodb collection\nCALL apoc.mongodb.first(host-or-port,db-or-null,collection-or-null,query-or-null,[compatibleValues=true|false]) yield value\nperform a first operation on mongodb collection\nCALL apoc.mongodb.find(host-or-port,db-or-null,collection-or-null,query-or-null,projection-or-null,sort-or-null,[compatibleValues=true|false],skip-or-null)\n                                 yield value\nperform a find,project,sort operation on mongodb collection\nCALL apoc.mongodb.insert(host-or-port,db-or-null,collection-or-null,list-of-maps)\ninserts the given documents into the mongodb collection\nCALL apoc.mongodb.delete(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value\ndeletes the given documents from the mongodb collection and returns the number of affected documents\nCALL apoc.mongodb.update(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value\nupdates the given documents from the mongodb collection and returns the number of affected documents\nIf your documents have date fields or any other type that can be automatically converted by Neo4j, you need to set\ncompatibleValues\nto true. These values will be converted according to Jackson databind default mapping.\nCopy these jars into the plugins directory:\nbson-3.4.2.jar\nmongo-java-driver-3.4.2.jar\nmongodb-driver-3.4.2.jar\nmongodb-driver-core-3.4.2.jar\nYou should be able to get them from\nhere\n, and\nhere (BSON)\n(via Download)\nOr you get them locally from your gradle build of apoc.\ngradle copyRuntimeLibs\ncp lib\/mongodb*.jar lib\/bson*.jar $NEO4J_HOME\/plugins\/\nCALL apoc.mongodb.first('mongodb:\/\/localhost:27017','test','test',{name:'testDocument'})\nIf you need automatic conversion of\nunpackable\nvalues then the cypher query will be:\nCALL apoc.mongodb.first('mongodb:\/\/localhost:27017','test','test',{name:'testDocument'},true)","attrs_markdown":"- [Operations Manual](https:\/\/neo4j.com\/docs\/operations-manual\/current)\n- [Developer Manual](https:\/\/neo4j.com\/docs\/developer-manual\/current\/)\n- [OGM Manual](https:\/\/neo4j.com\/docs\/ogm-manual\/current\/)\n- [Graph Algorithms](https:\/\/neo4j.com\/docs\/graph-algorithms\/current\/)\n- [APOC](https:\/\/neo4j-contrib.github.io\/neo4j-apoc-procedures\/3.5\/)\n- [Java Reference](https:\/\/neo4j.com\/docs\/java-reference\/current\/)\n\n[Database Modeling](https:\/\/neo4j-contrib.github.io\/neo4j-apoc-procedures\/3.5\/database-integration\/database-modeling\/)\n\n8\\.4. Interacting with MongoDB\n\n[ElasticSearch Integration](https:\/\/neo4j-contrib.github.io\/neo4j-apoc-procedures\/3.5\/database-integration\/elasticsearch\/)\n\n## 8\\.4. Interacting with MongoDB\n|   |   |\n|---|---|\n|   | perform a find operation on mongodb collection |\n| `CALL apoc.mongodb.count(host-or-port,db-or-null,collection-or-null,query-or-null) yield value` | perform a find operation on mongodb collection |\n| `CALL apoc.mongodb.first(host-or-port,db-or-null,collection-or-null,query-or-null,[compatibleValues=true|false]) yield value` | perform a first operation on mongodb collection |\n|   | perform a find,project,sort operation on mongodb collection |\n| `CALL apoc.mongodb.insert(host-or-port,db-or-null,collection-or-null,list-of-maps)` | inserts the given documents into the mongodb collection |\n| `CALL apoc.mongodb.delete(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value` | deletes the given documents from the mongodb collection and returns the number of affected documents |\n| `CALL apoc.mongodb.update(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value` | updates the given documents from the mongodb collection and returns the number of affected documents |\n\nIf your documents have date fields or any other type that can be automatically converted by Neo4j, you need to set **compatibleValues** to true. These values will be converted according to Jackson databind default mapping.\n\nCopy these jars into the plugins directory:\n\n- bson-3.4.2.jar\n- mongo-java-driver-3.4.2.jar\n- mongodb-driver-3.4.2.jar\n- mongodb-driver-core-3.4.2.jar\n\nYou should be able to get them from [here](https:\/\/mongodb.github.io\/mongo-java-driver\/), and [here (BSON)](https:\/\/mvnrepository.com\/artifact\/org.mongodb\/bson\/3.4.2) (via Download)\n\nOr you get them locally from your gradle build of apoc.\n```\ngradle copyRuntimeLibs\ncp lib\/mongodb*.jar lib\/bson*.jar $NEO4J_HOME\/plugins\/\n```\n```\nCALL apoc.mongodb.first('mongodb:\/\/localhost:27017','test','test',{name:'testDocument'})\n```\nIf you need automatic conversion of **unpackable** values then the cypher query will be:\n```\nCALL apoc.mongodb.first('mongodb:\/\/localhost:27017','test','test',{name:'testDocument'},true)\n```","attrs_readable_markdown":"- [Operations Manual](https:\/\/neo4j.com\/docs\/operations-manual\/current)\n- [Developer Manual](https:\/\/neo4j.com\/docs\/developer-manual\/current\/)\n- [OGM Manual](https:\/\/neo4j.com\/docs\/ogm-manual\/current\/)\n- [Graph Algorithms](https:\/\/neo4j.com\/docs\/graph-algorithms\/current\/)\n- [APOC](https:\/\/neo4j-contrib.github.io\/neo4j-apoc-procedures\/3.5\/)\n- [Java Reference](https:\/\/neo4j.com\/docs\/java-reference\/current\/)\n\n|   |   |\n|---|---|\n|   | perform a find operation on mongodb collection |\n| `CALL apoc.mongodb.count(host-or-port,db-or-null,collection-or-null,query-or-null) yield value` | perform a find operation on mongodb collection |\n| `CALL apoc.mongodb.first(host-or-port,db-or-null,collection-or-null,query-or-null,[compatibleValues=true|false]) yield value` | perform a first operation on mongodb collection |\n|   | perform a find,project,sort operation on mongodb collection |\n| `CALL apoc.mongodb.insert(host-or-port,db-or-null,collection-or-null,list-of-maps)` | inserts the given documents into the mongodb collection |\n| `CALL apoc.mongodb.delete(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value` | deletes the given documents from the mongodb collection and returns the number of affected documents |\n| `CALL apoc.mongodb.update(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value` | updates the given documents from the mongodb collection and returns the number of affected documents |\n\nIf your documents have date fields or any other type that can be automatically converted by Neo4j, you need to set **compatibleValues** to true. These values will be converted according to Jackson databind default mapping.\n\nCopy these jars into the plugins directory:\n\n- bson-3.4.2.jar\n- mongo-java-driver-3.4.2.jar\n- mongodb-driver-3.4.2.jar\n- mongodb-driver-core-3.4.2.jar\n\nYou should be able to get them from [here](https:\/\/mongodb.github.io\/mongo-java-driver\/), and [here (BSON)](https:\/\/mvnrepository.com\/artifact\/org.mongodb\/bson\/3.4.2) (via Download)\n\nOr you get them locally from your gradle build of apoc.\n```\ngradle copyRuntimeLibs\ncp lib\/mongodb*.jar lib\/bson*.jar $NEO4J_HOME\/plugins\/\n```\n```\nCALL apoc.mongodb.first('mongodb:\/\/localhost:27017','test','test',{name:'testDocument'})\n```\nIf you need automatic conversion of **unpackable** values then the cypher query will be:\n```\nCALL apoc.mongodb.first('mongodb:\/\/localhost:27017','test','test',{name:'testDocument'},true)\n```","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

6 days ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0.2 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://neo4j-contrib.github.io/neo4j-apoc-procedures/3.5/database-integration/mongodb/
Last Crawled	2026-04-03 21:07:59 (6 days ago)
First Indexed	2019-03-11 11:02:21 (7 years ago)
HTTP Status Code	200
Meta Title	8.4. Interacting with MongoDB - Chapter 8. Database Integration
Meta Description	null
Meta Canonical	null
Boilerpipe Text	Operations Manual Developer Manual OGM Manual Graph Algorithms APOC Java Reference CALL apoc.mongodb.get(host-or-port,db-or-null,collection-or-null,query-or-null,[compatibleValues=true\|false],skip-or-null,limit-or-null) yield value perform a find operation on mongodb collection CALL apoc.mongodb.count(host-or-port,db-or-null,collection-or-null,query-or-null) yield value perform a find operation on mongodb collection CALL apoc.mongodb.first(host-or-port,db-or-null,collection-or-null,query-or-null,[compatibleValues=true\|false]) yield value perform a first operation on mongodb collection CALL apoc.mongodb.find(host-or-port,db-or-null,collection-or-null,query-or-null,projection-or-null,sort-or-null,[compatibleValues=true\|false],skip-or-null) yield value perform a find,project,sort operation on mongodb collection CALL apoc.mongodb.insert(host-or-port,db-or-null,collection-or-null,list-of-maps) inserts the given documents into the mongodb collection CALL apoc.mongodb.delete(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value deletes the given documents from the mongodb collection and returns the number of affected documents CALL apoc.mongodb.update(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value updates the given documents from the mongodb collection and returns the number of affected documents If your documents have date fields or any other type that can be automatically converted by Neo4j, you need to set compatibleValues to true. These values will be converted according to Jackson databind default mapping. Copy these jars into the plugins directory: bson-3.4.2.jar mongo-java-driver-3.4.2.jar mongodb-driver-3.4.2.jar mongodb-driver-core-3.4.2.jar You should be able to get them from here , and here (BSON) (via Download) Or you get them locally from your gradle build of apoc. gradle copyRuntimeLibs cp lib/mongodb.jar lib/bson.jar $NEO4J_HOME/plugins/ CALL apoc.mongodb.first('mongodb://localhost:27017','test','test',{name:'testDocument'}) If you need automatic conversion of unpackable values then the cypher query will be: CALL apoc.mongodb.first('mongodb://localhost:27017','test','test',{name:'testDocument'},true)
Markdown	- [Operations Manual](https://neo4j.com/docs/operations-manual/current) - [Developer Manual](https://neo4j.com/docs/developer-manual/current/) - [OGM Manual](https://neo4j.com/docs/ogm-manual/current/) - [Graph Algorithms](https://neo4j.com/docs/graph-algorithms/current/) - [APOC](https://neo4j-contrib.github.io/neo4j-apoc-procedures/3.5/) - [Java Reference](https://neo4j.com/docs/java-reference/current/) [Database Modeling](https://neo4j-contrib.github.io/neo4j-apoc-procedures/3.5/database-integration/database-modeling/) 8\.4. Interacting with MongoDB [ElasticSearch Integration](https://neo4j-contrib.github.io/neo4j-apoc-procedures/3.5/database-integration/elasticsearch/) ## 8\.4. Interacting with MongoDB \| \| \| \|---\|---\| \| \| perform a find operation on mongodb collection \| \| `CALL apoc.mongodb.count(host-or-port,db-or-null,collection-or-null,query-or-null) yield value` \| perform a find operation on mongodb collection \| \| `CALL apoc.mongodb.first(host-or-port,db-or-null,collection-or-null,query-or-null,[compatibleValues=true\|false]) yield value` \| perform a first operation on mongodb collection \| \| \| perform a find,project,sort operation on mongodb collection \| \| `CALL apoc.mongodb.insert(host-or-port,db-or-null,collection-or-null,list-of-maps)` \| inserts the given documents into the mongodb collection \| \| `CALL apoc.mongodb.delete(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value` \| deletes the given documents from the mongodb collection and returns the number of affected documents \| \| `CALL apoc.mongodb.update(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value` \| updates the given documents from the mongodb collection and returns the number of affected documents \| If your documents have date fields or any other type that can be automatically converted by Neo4j, you need to set compatibleValues to true. These values will be converted according to Jackson databind default mapping. Copy these jars into the plugins directory: - bson-3.4.2.jar - mongo-java-driver-3.4.2.jar - mongodb-driver-3.4.2.jar - mongodb-driver-core-3.4.2.jar You should be able to get them from [here](https://mongodb.github.io/mongo-java-driver/), and [here (BSON)](https://mvnrepository.com/artifact/org.mongodb/bson/3.4.2) (via Download) Or you get them locally from your gradle build of apoc. ``` gradle copyRuntimeLibs cp lib/mongodb.jar lib/bson.jar $NEO4J_HOME/plugins/ ``` ``` CALL apoc.mongodb.first('mongodb://localhost:27017','test','test',{name:'testDocument'}) ``` If you need automatic conversion of unpackable values then the cypher query will be: ``` CALL apoc.mongodb.first('mongodb://localhost:27017','test','test',{name:'testDocument'},true) ```
Readable Markdown	- [Operations Manual](https://neo4j.com/docs/operations-manual/current) - [Developer Manual](https://neo4j.com/docs/developer-manual/current/) - [OGM Manual](https://neo4j.com/docs/ogm-manual/current/) - [Graph Algorithms](https://neo4j.com/docs/graph-algorithms/current/) - [APOC](https://neo4j-contrib.github.io/neo4j-apoc-procedures/3.5/) - [Java Reference](https://neo4j.com/docs/java-reference/current/) \| \| \| \|---\|---\| \| \| perform a find operation on mongodb collection \| \| `CALL apoc.mongodb.count(host-or-port,db-or-null,collection-or-null,query-or-null) yield value` \| perform a find operation on mongodb collection \| \| `CALL apoc.mongodb.first(host-or-port,db-or-null,collection-or-null,query-or-null,[compatibleValues=true\|false]) yield value` \| perform a first operation on mongodb collection \| \| \| perform a find,project,sort operation on mongodb collection \| \| `CALL apoc.mongodb.insert(host-or-port,db-or-null,collection-or-null,list-of-maps)` \| inserts the given documents into the mongodb collection \| \| `CALL apoc.mongodb.delete(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value` \| deletes the given documents from the mongodb collection and returns the number of affected documents \| \| `CALL apoc.mongodb.update(host-or-port,db-or-null,collection-or-null,list-of-maps) yield value` \| updates the given documents from the mongodb collection and returns the number of affected documents \| If your documents have date fields or any other type that can be automatically converted by Neo4j, you need to set compatibleValues to true. These values will be converted according to Jackson databind default mapping. Copy these jars into the plugins directory: - bson-3.4.2.jar - mongo-java-driver-3.4.2.jar - mongodb-driver-3.4.2.jar - mongodb-driver-core-3.4.2.jar You should be able to get them from [here](https://mongodb.github.io/mongo-java-driver/), and [here (BSON)](https://mvnrepository.com/artifact/org.mongodb/bson/3.4.2) (via Download) Or you get them locally from your gradle build of apoc. ``` gradle copyRuntimeLibs cp lib/mongodb.jar lib/bson.jar $NEO4J_HOME/plugins/ ``` ``` CALL apoc.mongodb.first('mongodb://localhost:27017','test','test',{name:'testDocument'}) ``` If you need automatic conversion of unpackable values then the cypher query will be: ``` CALL apoc.mongodb.first('mongodb://localhost:27017','test','test',{name:'testDocument'},true) ```
Shard	143 (laksa)
Root Hash	2566890010099092343
Unparsed URL	io,github!neo4j-contrib,/neo4j-apoc-procedures/3.5/database-integration/mongodb/ s443