🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 139,578
Showing: Page 2 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:857 9555450589887180400164.100.77.10022026-04-13 09:10:162026-04-13 09:10:168572026-04-13 09:10:16laksa000
SPAM:769 10910209459240751800164.68.123.250592026-01-06 03:09:552026-03-31 17:25:047692026-03-31 17:25:04laksa000
SPAM:750 10910209459240751800164.68.123.250592026-04-13 09:10:162026-04-13 09:10:167502026-04-13 09:10:16laksa000
SPAM:0 12431616285166001400164.92.153.5172026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:833 15981484875185695400165.22.55.170772026-01-06 03:09:552026-03-31 17:25:048332026-03-31 17:25:04laksa000
SPAM:909 15981484875185695400165.22.55.170772026-04-13 09:10:162026-04-13 09:10:169092026-04-13 09:10:16laksa000
SPAM:0 15658031139269911200165.22.55.215562026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12055060556006821600165.22.58.8882026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12449576520644536600165.227.87.57832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11519477333241105600165.232.165.60282026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2151882016404823600165.232.172.219182026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 10639217919679179000167.172.6.229952026-01-14 03:13:162026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 10639217919679179000167.172.6.229952026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 14766154466089828600167.172.65.21432026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14034117018279103600167.250.141.141182026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 16082573934938762800167.71.206.205142026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13332377675647593400167.71.206.51672026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8965662566105959800167.71.220.54992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 4382722325788984400167.71.221.130222026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 4382722325788984400167.71.221.130222026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 5165080557830656800167.99.200.108842026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 15512445685596248000167.99.68.236402026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 9181436681662440000172.104.165.22202026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 14320509746803961400172.104.172.12472026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 14320509746803961400172.104.172.12472026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 16582959369803947000172.105.118.128352026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 9542474147660660600172.105.204.13632026-01-06 03:09:552026-03-18 05:55:247002026-03-18 05:55:24laksa000
SPAM:0 10385247123523489200172.217.1.110462026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15278287350774912200172.217.26.174612026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1179293373336220800172.234.230.9742026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8264374017010810200173.255.196.31512026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11507266233232222200174.138.28.176112026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7482637186077910400174.143.180.119522026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 8480140260728148400176.9.117.189422026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15633099873412978200178.128.105.86912026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 17744376968218098200178.128.168.68912026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 4573896744051262000178.128.52.206102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 3103782538250526600178.128.90.48332026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 3103782538250526600178.128.90.48332026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 12487137382161363800178.128.94.191192026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 12487137382161363800178.128.94.191192026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 2749816145976028600178.128.95.31432026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 2749816145976028600178.128.95.31432026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 3334489353868047800178.79.164.80392026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 1554368542986093240018.142.203.33622026-03-18 05:55:242026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 1554368542986093240018.142.203.33622026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 901852881967685940018.180.33.200972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1208900275912582020018.228.135.12912026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 14756194782744964000185.47.48.205202026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 8889552407979517000188.166.157.62852026-01-13 07:00:512026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 8889552407979517000188.166.157.62852026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 10602775715849607000188.166.198.254352026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 10602775715849607000188.166.198.254352026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 10419875990846860000192.3.47.23102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15273012582979021400193.6.150.22772026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 18232703087561649400194.135.92.135472026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 968776681437290600194.163.149.74532026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7779235435736119400194.233.67.32972026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 13488569810150220200194.67.110.21412026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:750 3580659326457539200194.67.119.99962026-01-13 07:00:512026-03-31 17:25:047502026-03-31 17:25:04laksa000
SPAM:0 14626833290354745600195.117.19.250282026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 12030197755208828400195.24.64.11422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13747145172063466800195.248.71.48342026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11661892841094199600196.43.162.77982026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 9590011391797981400196.43.221.1672026-01-22 02:10:162026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 8362867048940525000198.204.111.100252026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 11104969123880322800199.192.23.222142026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1030040936214297880020.2.157.76942026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1627181544649228380020.46.247.101192026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5161867755809520000202.127.1.3902026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 149483844899959200202.3.77.184962026-01-22 02:10:162026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 3930349538415816200206.189.151.161812026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14084294314003536800206.189.40.206842026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2932342652386718000206.189.44.44902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8998364065695308800206.189.90.22442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14961168827816393000206.189.92.175652026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 5804189426489705000207.148.123.59252026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 5804189426489705000207.148.123.59252026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:923 18427217480145616600207.148.124.35832026-01-13 07:00:512026-03-31 17:25:049232026-03-31 17:25:04laksa000
SPAM:928 18427217480145616600207.148.124.35832026-04-13 09:10:162026-04-13 09:10:169282026-04-13 09:10:16laksa000
SPAM:0 15509400086780191800207.148.248.157592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:826 4622078641885300000209.172.60.6802026-01-06 03:09:552026-03-31 17:25:048262026-03-31 17:25:04laksa000
SPAM:857 4622078641885300000209.172.60.6802026-04-13 09:10:162026-04-13 09:10:168572026-04-13 09:10:16laksa000
SPAM:1000 703491389635818000209.38.26.195902026-01-13 07:00:512026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 703491389635818000209.38.26.195902026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 6988248694160600400209.38.83.20322026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1068419936391291400209.97.168.89572026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14737877154318829600210.71.121.211482026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15984532562508098000210.71.66.12902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6400783624961370400210.76.80.148522026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 13989918187594282800212.2.217.115142026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17709797267836365200212.83.147.29262026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17868961521823805600216.58.207.234282026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4442512683657084003.0.40.5422026-02-03 06:27:312026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:814 86888633145032736003.224.39.218682026-01-06 03:09:552026-03-31 17:25:048142026-03-31 17:25:04laksa000
SPAM:0 137445750561310508003.228.200.123542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 148781194308451708003.6.0.16542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 133084891960425024003.76.171.232122026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 81988839005286966003.95.97.84832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1203968439039022020031.14.238.8812026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))