🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 29 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 5112023357408043400directcut.be172026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:800 13682420518612325400dlsinvigo.be272026-01-06 03:09:552026-03-18 05:55:248002026-03-18 05:55:24laksa000
SPAM:0 12800076801672633200dnwestate.be662026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8383273427161977200dokterdewulf.be862026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8189799164923519000doktervandeveldestef.be952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7942010285374411400dooh-media.be572026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9603445248855869200dranken-asterx.be462026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:814 6491908045848995800drlal.be792026-01-06 03:09:552026-04-13 09:10:168142026-04-13 09:10:16laksa000
SPAM:700 13386562173139519400dronedate.be972026-03-24 07:10:182026-03-24 07:10:187002026-03-24 07:10:18laksa000
SPAM:0 258088698340523200drostof.be162026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4751902756236553400dsd-construct.be672026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9748575899043589000dubstep.be452026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 18276002822823902800dvv-simulateurobseques.be142026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14213463019286294400dwvermeersch.be722026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16475987848169131400dzconstruct.be572026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16225447890104652200easyfresh.be612026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4368149069973776000echo.be802026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6674180748690166200ecosports.be312026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 7193963296934275600eddyvanhout.be782026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17632629884416485000edu-web.be252026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 12749942827766820000eduart.be02026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17423284296861574800educasport-bxl.be742026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 3307549922455527600edwinthomasgalerie.be382026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4724550030484713600eenteamvoorhetleven.be682026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 327219876393588800eiscafe-ilgelatone.be442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6595441324074179000elmarreizen.be952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10673919418294075800elseviers.be792026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 3301034720822830200email-handtekening.be512026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:0 4405449826239127800energiezuinigverwarmen.be392026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5143829310018895600engo-events.be782026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9568570070145916000entretien-abattage-elagage-jardin.be802026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:916 8054491350145887400erc10yrs.be372026-01-06 03:09:552026-04-13 09:10:169162026-04-13 09:10:16laksa000
SPAM:0 8459155850628567600ergo-insurance.be382026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11569498456953213600etacup.be682026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 178355035589844200euro-millions.be212026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6557361894296701400eurobyte.be72026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8811624233614324400evangelischegemeente-ichtegem.be222026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:842 16807952634379826400events-ticket.be322026-02-03 06:27:312026-04-13 09:10:168422026-04-13 09:10:16laksa000
SPAM:0 2369269363778132200everesst.be612026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17839290485770788600evsound.be432026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17567988778031142600ewoutstupperwarestall.be132026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9534185322951792600expertplus.be632026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11122193116278818400extrascolaire.be922026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1557568464823225200faacwebshop.be262026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15579214477171395600falstaffresto.be782026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 4177881348763044800febetec.be242026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 2419656837068280200felicityfashionblog.be12026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8354587230173421400fetishdate.be72026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8352011407955152000fidalmi.be602026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 3413150988082117000fietsenvanuitieper.be852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8058639151039521400filagri.be72026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14652704946796091600fitamorfosa.be582026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2314424034055394800flamme.be742026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16257084069745715200flandersdogacademy.be762026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 2520047288424802800flautino.be142026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:1000 146373520500541800flirt24.be92026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 12381039382088930000floral-design.be502026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 16891472669733427000focusonlight.be352026-01-06 03:09:552026-03-31 17:25:046662026-03-31 17:25:04laksa000
SPAM:0 17993900846104830400food2go-hasselt.be522026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14612199022666284400fotoclublatem.be222026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15029947372317106000fotografiedavid.be302026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14110901990559739800foxnetwork.be992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12488675118194281400fraidilux.be72026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 8476566219253396000fredzone.be802026-02-03 06:27:312026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 15493868152264518200freeenergy.be912026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 5761906208532671000freenet.be552026-03-18 05:55:242026-03-18 05:55:247002026-03-18 05:55:24laksa000
SPAM:0 13674667487075353600freshmind.be682026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:660 12025017711548247400frietkotcultuur.be372026-01-06 03:09:552026-03-24 07:10:186602026-03-24 07:10:18laksa000
SPAM:0 5799687413320962800fusiongym.be142026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16808508828541673800gaca.be692026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15732199306549317600garagevanhellemont.be882026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2866189463633170600gdelec.be532026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1175886507714158600gezinophetwerk.be932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18275242613651850400gios.be522026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7058945117535911800gmtbv.be592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5724236285879654200gokkasten-spelen.be712026-02-10 04:07:202026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 1367778510827229000goodcare.be452026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10871857987955225000gordonvikingdays.be252026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3608779065052277000goudenspike.be852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6274982623691387800gpf.be392026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12020866489591175800grandprixcerami.be792026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 17100191153952867600graphicsandmore.be382026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10354303076061506200graslanddemo.be312026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4067154452125056600greindl.be832026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 17074308056139533200groeplauwereys.be662026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2237769646799487400groupelmp.be372026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16436519825456904000gwendyclemens.be202026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 3619164917288675800gysemans-vastgoedoranje.be792026-01-13 07:00:512026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:0 1921195445655241600hagelunie.be82026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9942502378586476400happy-family.be822026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2444851783728997400hardwarespare.be872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6511518293216562000haroldpolis.be102026-02-10 04:07:202026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 8210656992107607600havanahouse.be382026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17903149435844400600healthsupport.be32026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8604742060715397400hetsteenisopen.be872026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:660 3569633816221364400hexjumper.be222026-01-06 03:09:552026-04-13 09:10:166602026-04-13 09:10:16laksa000
SPAM:0 17137965165620482400hill60.be122026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 17722094528596599000hjno.be952026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 9631988446027006000hmbrs.be302026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15401662542915700000homieshelp.be02026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))