🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 28 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 14967568060271758000broad.be902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16388921447587983000buderus-service.be152026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17979616417493810000bureauranst.be502026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7890343245704479600bussiron.be982026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10053364099636148000bvbaschildermans.be402026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6236805532422342800bzwaterloo.be142026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9874035302164865200c-et.be262026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2802380821011443600carcornergroup.be182026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 4598642933136091000careathome.be552026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4130483102567059800carkitcenter.be992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7821227934034634400caroconfort.be722026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6081069855100503000carrosserie-supercars.be152026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3642729736958342400carrosseriesmet.be122026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7272321806458749400carved.be472026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2462362507503691000cattaneobouwkranen.be552026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10730644110826266200cecile-delhaye.be312026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 6700319008473213400challengesommets.be672026-01-06 03:09:552026-04-13 09:10:167002026-04-13 09:10:16laksa000
SPAM:0 14358185443138851800champ-hannut.be592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10886032032152361600changeablejewelry.be82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8106531493589516000charlelec.be802026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12464476829913449000chevreriedelobel.be452026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2289308343821821200chezarthur.be62026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12713165402873910600chezcalia.be532026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1585646455393858000chiptuning-jeep.be902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4832017953811403600chirosnaaskerke.be182026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18214756430790611600choose-the-one.be582026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3997682718949897000chorale-saint-vincent.be852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15769585694612885800ciap.be292026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15232480483080286600cicatrix.be332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3496604563634714600cigre.be732026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3705225627646757800clbmandelenleie.be892026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14320895707252135400clbroeselare.be772026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5786404044709113200clininet.be662026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 241899318670625200clouddragon.be262026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10683573876964885600clymax.be282026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7237191638259916600cmmartin.be832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7608571880547968800cnrf.be442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14122929699706257200coachingpreudhomme.be862026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1285766542509172000coenegrachts-stables.be602026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8451179101660347200cofinpar.be362026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5685411284458840000coghamo.be02026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:760 14391421848644857400cognitio.be872026-01-13 07:00:512026-04-13 09:10:167602026-04-13 09:10:16laksa000
SPAM:0 9020482800286262000cohousingplatform.be102026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15198403058596647200colorprinter.be362026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 11287272405322796400comflor.be822026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16336955155451796000comfortcamping.be802026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14045195396569307600considera.be382026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:800 3402110658984828200consiko.be412026-02-17 04:56:342026-03-24 07:10:188002026-03-24 07:10:18laksa000
SPAM:0 895987958170595000containersvandaele.be752026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10897163284916415400contra.be772026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6976753372427554600coqrock.be732026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 2759927552614701200corlato.be62026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:703 1273461877165541600correctcommunications.be82026-01-06 03:09:552026-04-13 09:10:167032026-04-13 09:10:16laksa000
SPAM:0 14501894911969007000cotedopale.be352026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 12474088985439649000courbes.be452026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10431272267662431800cousaert.be592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:769 3745497197933320400coverfesty.be22026-01-06 03:09:552026-03-31 17:25:047692026-03-31 17:25:04laksa000
SPAM:0 718793625397206800creaphoto.be342026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5087631801589006400creations-group.be322026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15690457425653580600culturelebiografievlaanderen.be32026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 3614437087186562200dacan.be112026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 2974383772192655600daglichtinstallateur.be782026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11776761409329025000dagvandeklant.be252026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 1354194756809863000dakralux.be152026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 666057741663035200dakwerken-boscart.be762026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6188115247442342000dakwerken-vdv.be102026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6408197716681830200dakwerkenmc.be512026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2455413786856565000dakwerkenmulders.be252026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4246387277392253800dakwerkenvanheckejochen.be692026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10422162560032572800danjou.be642026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15151038246252900000datatestlab.be02026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15493432248334446200dblc.be312026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10063782028763155400ddays.be772026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4522338405610714600debouchages-canalisations.be732026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15696216384633786000debuffetwagon.be302026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12867649354733229600decube.be482026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 7754704362425355800dedigitaleboekentas.be792026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13773660189095981800dedommel.be92026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7521973006392641200degreve.be62026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 190203159656259200delphinemortier.be962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:920 5067728447819576400demensentuin.be822026-01-13 07:00:512026-04-13 09:10:169202026-04-13 09:10:16laksa000
SPAM:0 8527220884736118600demofarm.be932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 240508173568234000demolitech.be702026-01-06 03:09:552026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:0 15570247144609844800depieters.be242026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2954615990734912400desnercknv.be622026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17257313448549203200devolderpierre.be162026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 9199085051878259600devray.be982026-01-22 02:10:162026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 15018176806923748600dewijnhoeve.be432026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12178816741119031800dezaegershoe.be592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:800 5265336060429352400dezwartehand.be622026-01-06 03:09:552026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:857 14165409601024713400dhcnet.be672026-01-06 03:09:552026-04-13 09:10:168572026-04-13 09:10:16laksa000
SPAM:0 540564977838302800dhrenov.be142026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6421619662019270200diamantboring.be512026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12032352471661256000diamondship.be802026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16361785239106601000diaz-warmte.be52026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16350055545302134800didierdemorcy.be742026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 4574669806654085000dieethuis.be252026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:800 726100437729234800dierenpensionreview.be742026-01-06 03:09:552026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:0 12032734162313878200digital-asbl.be912026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:722 11826690046473119000dillenhof.be952026-01-14 03:13:162026-04-13 09:10:167222026-04-13 09:10:16laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))