🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 6 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:692 885878246032699800hijridate.ai992026-01-14 03:13:162026-04-13 09:10:166922026-04-13 09:10:16laksa000
SPAM:714 5383722102201833200hipercube.ai662026-01-06 03:09:552026-04-13 09:10:167142026-04-13 09:10:16laksa000
SPAM:0 1142802969781887400hivemarket.ai372026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7586578378293120800hst.ai42026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 306775128870694400htc.ai722026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 6499350890573318400hustleandflowstate.ai922026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12711467108307664800hyperscreen.ai242026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8642204552332817800icommit.ai892026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8228779025820443400iluy.ai172026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16421863707811509800inquizyt.ai492026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14896975110710981600ipayment.ai82026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3898807495771328600itcontrols.ai432026-01-13 07:00:512026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 13499000205755644000jdm.ai202026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15316208368447585000kagoj.ai252026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:882 14162773899691511000kzhu.ai552026-01-06 03:09:552026-04-13 09:10:168822026-04-13 09:10:16laksa000
SPAM:1000 8100214548795476400ladybend.ai822026-01-13 07:00:512026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:0 3309147442515522400laifu.ai122026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12447449503847794400landingpro.ai722026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:923 8987271088497514200lode88.ai712026-03-18 05:55:242026-03-18 05:55:249232026-03-18 05:55:24laksa000
SPAM:0 17476326729363407600masterflo.ai382026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 13524154420158190000mcpsnitch.ai502026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15593304818917499200medicalcannabis.ai962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13113545117906259400meetflow.ai972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6130152221110332800memetic.ai642026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18332977059309565800merceros.ai292026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 8724303191943558600merlyn.ai932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10281421548216503800monkeyterminal.ai192026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9847087479358851400mth.ai572026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5129409763537631400mystral.ai572026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7604434932841905400mytasha.ai272026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2677932789441472000nanabanano.ai602026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13324136715746546600nasx.ai332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11422808429305778600nexo.ai932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16787857751056870800nirad.ai542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10967145883747061800oilfield.ai92026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:909 6816413181068352400openimage.ai622026-02-10 04:07:202026-04-13 09:10:169092026-04-13 09:10:16laksa000
SPAM:0 18158486972910388400pallet.ai422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4290844770505652000parties.ai602026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 8683714584966571400pentacle.ai572026-01-13 07:00:512026-03-18 05:55:246662026-03-18 05:55:24laksa000
SPAM:650 8720317501266408000plug-n-play.ai402026-01-13 07:00:512026-03-18 05:55:246502026-03-18 05:55:24laksa000
SPAM:0 133226993892339600podhost.ai982026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3825935388402258400prognostic.ai922026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:800 2805760294238263200promptlux.ai162026-01-06 03:09:552026-03-18 05:55:248002026-03-18 05:55:24laksa000
SPAM:0 7334749833992085400proptest.ai272026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9065461505441251800pubrise.ai592026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10650643052361343200quantumlearnings.ai162026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17177475392095064000quillnow.ai202026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4936324808421924400quynhon.ai222026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 9002490414518689200raw.ai462026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:750 3709049956778937800rhumba.ai892026-01-13 07:00:512026-04-13 09:10:167502026-04-13 09:10:16laksa000
SPAM:0 10436824027751217800rhythmental.ai892026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:714 11453458850626275800saad.ai792026-01-06 03:09:552026-04-13 09:10:167142026-04-13 09:10:16laksa000
SPAM:0 13188840125590105600saferin.ai282026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 18059073858177777600scene.ai882026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2690274071680924800secusy.ai242026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9869164953223706200seosleuth.ai312026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11510430816640081000sightness.ai52026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16624518264267258800sinema.ai942026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:900 12501824501367708400sitetoday.ai422026-01-06 03:09:552026-04-13 09:10:169002026-04-13 09:10:16laksa000
SPAM:0 17663783743053214400soy.ai722026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9861329392853048400sprw.ai422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10728859400047253400stacx.ai672026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13657735596362171200starcode.ai562026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 15606454285987880000svet.ai02026-01-06 03:09:552026-03-31 17:25:047002026-03-31 17:25:04laksa000
SPAM:0 2021845353746865000switchpass.ai252026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7007028734461146200swyke.ai312026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:705 16559518026718661400syntes.ai72026-01-06 03:09:552026-03-18 05:55:247052026-03-18 05:55:24laksa000
SPAM:0 3130201369824769600teddy.ai482026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3440796362463530400teragon.ai522026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14868555468688455600theremin.ai782026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:714 17434946856006871200thertb.ai562026-01-06 03:09:552026-04-13 09:10:167142026-04-13 09:10:16laksa000
SPAM:0 14180104212970434600thru.ai732026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8795312790133996600timeglass.ai832026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:666 7390351294795298400tmind.ai922026-01-13 07:00:512026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:0 2460419603363508600toscano.ai432026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14981282262955220400trybaton.ai22026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:750 14079848677835075200uidraft.ai762026-01-13 07:00:512026-03-31 17:25:047502026-03-31 17:25:04laksa000
SPAM:840 15645691190932930000umwelt.ai502026-01-06 03:09:552026-04-13 09:10:168402026-04-13 09:10:16laksa000
SPAM:0 13835233217403172600videoster.ai632026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 430856061174866600virtualagents.ai332026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 928069331836122000virtuallyseth.ai102026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15822097943606682200virtualmate.ai112026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13359906630054987400votie.ai372026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10333231593995100200vulk.ai12026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7789651255681318000w3w.ai902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1732509210099492200weatherthisweek.ai612026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18382687086341252600where.ai632026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6221427848740378000wisevantage.ai902026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 10634635775583982600wt3.ai132026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14518760391206282600xcv.ai132026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8222497469878405200xemdagatructiep.ai262026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18182335588899696000xley.ai802026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 4706675685545923800xtechnology.ai192026-02-17 04:56:342026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:655 15482352533775446000yanus.ai302026-01-06 03:09:552026-03-24 07:10:186552026-03-24 07:10:18laksa000
SPAM:0 9575708194003835400zakupki.ai772026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15760848323165222000zapsign.ai102026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4306330600879841400zattara.ai72026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3018710779817389400zereus.ai472026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3372916226495362400zoto.ai122026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10942611546531501000666.airforce52026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))