🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 32 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 2069374249431020400partyz.be22026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10246576845601769400paskwal.be472026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9912071439107099000pastridor.be952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1049466484478431600patrickdebleeckere.be582026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5234108440045454800patronale-solar.be742026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11065084806002494600peaceinthecity.be732026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10982958344451181400pecten.be72026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1293140648482357400pendora.be872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4249283762864032400perioclic.be622026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5548310702945119200peter-paul.be962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2112612008254471800pietel.be592026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9396880704177133800pizzacafegent.be692026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15794083626603669800plansamenleven.be492026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:800 8974245227256974400plantesmedicinales.be722026-01-06 03:09:552026-03-18 05:55:248002026-03-18 05:55:24laksa000
SPAM:0 11363537834078463200plantis.be162026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 1448676191902528600plattelandmetstem.be432026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:1000 12379196640602627200playerinput.be362026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 7035647648541802600playone.be132026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 13979793520694132800playplinko.be642026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 651784224146423800poldergote.be192026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10358643059814001200politiezoneriho.be62026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4928675601917109000pooz.be452026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16011171441259544800pricewise.be242026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16232521784550312200primustel.be612026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3343308250624273200pro-jekt.be662026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8612661309175283200psychogoed.be162026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17280421368325093200purnatur.be662026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9201606243983338000qdb-test.be902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:717 9720351800874405800quizmaken.be292026-02-10 04:07:202026-03-31 17:25:047172026-03-31 17:25:04laksa000
SPAM:0 6093042653999575200quro.be762026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5543886048670768000r-vent.be402026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7514556471045219400rallyfoto.be972026-01-14 03:13:162026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 12663324003734088600rdcv.be432026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 2059744190261897800rdi-tubize.be892026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:869 4782503221630352000realyse.be602026-01-06 03:09:552026-04-13 09:10:168692026-04-13 09:10:16laksa000
SPAM:0 7686870040261788400reclamegeschenken.be422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8039977008898368800redesignpodcast.be442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4880833952064297600registreducancer.be882026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8568322845235776400rehamot.be822026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1645459925293734600rekken.be732026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17980599534922921200renovatiesvanderheyden.be62026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6047436711750917400repondeurautomatik.be872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12001292833827728800reservaria.be442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8253868686120114000resplash.be702026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 5386544453431555400restaurantpizzeriaamaremio.be772026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:923 9318623551322207400revaceva.be372026-01-06 03:09:552026-04-13 09:10:169232026-04-13 09:10:16laksa000
SPAM:0 15719974954775549600revolte.be482026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 5372256670866011800rikwynants.be592026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 4225481214343260000rivivocoaching.be02026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13657030507761675400rogeco.be772026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1903138842153797200roodenhoed.be862026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:923 2742579101621679400roulette.be972026-01-13 07:00:512026-04-13 09:10:169232026-04-13 09:10:16laksa000
SPAM:0 3697073750421230200russes.be512026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4897815705795168200s-c.be412026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4383086585895484000s-i-c.be202026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4787270698658578400sameneruit.be922026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 7017576783249994000schilderwerkendecubber.be702026-03-18 05:55:242026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 4705864190070700200scholieren.be12026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17068470982929060000schoollab.be02026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6336782604658874000scia.be702026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4141300683310728800scrivendo.be442026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14067994684251505600sea-explorers.be282026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7667109472840761600secchaud.be82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:909 1527923657852607200segco.be362026-01-06 03:09:552026-03-31 17:25:049092026-03-31 17:25:04laksa000
SPAM:0 15200530918695506200serenteke.be312026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10683752017728766800servex.be342026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 2480222540306250000sexcontacten.be502026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 9295378776822972800sexflirts.be642026-01-06 03:09:552026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:769 10753905492811201400shogi.be72026-01-06 03:09:552026-04-13 09:10:167692026-04-13 09:10:16laksa000
SPAM:0 2760351724854560400sigway.be22026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 478107209495500400simergy.be22026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9894976334710233200sinfronteras.be662026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15342622862684230800sithu.be542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12527616370737762200six4ever.be112026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14093844037867555600sl50plus.be782026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 960514089809248400slabbie.be422026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:833 7872093156383621600slar.be82026-01-13 07:00:512026-03-18 05:55:248332026-03-18 05:55:24laksa000
SPAM:0 5293774011195017000slowgame.be852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1660329712482952600smartphonebril.be632026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6368785827012269000snelbouwsysteem.be452026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14418291660274023400sneldrukker.be172026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17688351080456065800sofi.be292026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8481929980306533000songapp.be652026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9003951451037088600souldigger.be432026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:687 12842466042453048400spanda.be422026-03-18 05:55:242026-03-18 05:55:246872026-03-18 05:55:24laksa000
SPAM:833 13549717844398158200spelinzicht.be912026-03-31 17:25:042026-04-13 09:10:168332026-04-13 09:10:16laksa000
SPAM:0 4510964100277481800spicecraftkitchen.be92026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 1752851350960650000sportelektronica.be502026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 4152474093334992000sportnieuws.be602026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 8253203750540987400srconline.be372026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6886161714670094000stager.be702026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 13885902310628043800stams.be192026-01-06 03:09:552026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:0 12980398732167282800stams-vancom.be142026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14079364402430524800starlines.be242026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:652 18016943462253600400statusgo.be22026-01-13 07:00:512026-03-24 07:10:186522026-03-24 07:10:18laksa000
SPAM:0 13229654864740109400steelcoatingconcept.be472026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10734851504239848800steendam.be442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17057638593636920800stefart.be42026-02-17 04:56:342026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:909 4277409744673492200stelobo.be612026-01-06 03:09:552026-03-31 17:25:049092026-03-31 17:25:04laksa000
SPAM:0 11284820214868005000steme.be252026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))