🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 27 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 1544461779805204120024it.be62026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 79957547437454140002advice.be702026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 34100465727884140033reasons.be72026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 68148139906932302003dlink.be512026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:880 138616098319320650003p-travel.be252026-01-06 03:09:552026-04-13 09:10:168802026-04-13 09:10:16laksa000
SPAM:0 178117246017392948004ev.be742026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6676568114836442006tot12.be212026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 11714992093070697000a20.be852026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 16307695159705343200abentuinaanleg.be162026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17150556087619164800absoluutgent10mijl.be242026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16427187319377442000acculaders.be102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1951932947119369000acm-audiosolutions.be452026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13656351777999547000adrienbauchau.be352026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5831713332461849000advocaat-erfrecht.be452026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3755658399320084000adw-technics.be202026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3718371281797300000aerts-somers.be02026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7874926497996281200aes-services.be62026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8770866242095003400agp-equipment.be172026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7246558098699927600aide-inondations.be382026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 5524445838778584000aisse.be202026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17166377964989310800allegorie-etc.be542026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8752756512271219600almasana.be982026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16593506236414374400altaramen.be722026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 2550905568688793200altezza.be662026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8468654928999693200aluk.be662026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 12070784022070466800amand.be342026-02-03 06:27:312026-03-24 07:10:186662026-03-24 07:10:18laksa000
SPAM:818 2003503335249884800amo-benelux.be242026-01-14 03:13:162026-03-31 17:25:048182026-03-31 17:25:04laksa000
SPAM:0 11431874956821284600amu.be232026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:800 10975950382424887000anarchief.be352026-01-13 07:00:512026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:0 8324687066671808200andaems.be412026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10796903396339461200androits.be62026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6982846192190554200animare.be712026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7578078061250196400annelease.be822026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10621470790730962200anno2021.be112026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:971 1202734285529910200annpurna.be512026-01-06 03:09:552026-04-13 09:10:169712026-04-13 09:10:16laksa000
SPAM:0 2247939761109610400antwerpsmannenkoor.be522026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10600835253668107000apples2oranges.be352026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:760 1374263099753307400apreciousmoment.be372026-01-06 03:09:552026-04-13 09:10:167602026-04-13 09:10:16laksa000
SPAM:0 15464270006876444200aquatazzcleaning.be212026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6467429855963886200arcanaschool.be312026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 12474848994580663400arnove.be172026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 11182689409691341000arpv.be52026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13420689899468425200arsnobilis.be262026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 4246828731963118600artinne.be932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10472564455146802000asblgeco.be102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18328707786921716200asblnda.be812026-01-14 03:13:162026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 469433652456420800asppn.be42026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14943962874334455200asproductions.be762026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4749991726021053200assur-plombier.be662026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:769 9472166821013443800atelierhermessage.be192026-01-06 03:09:552026-04-13 09:10:167692026-04-13 09:10:16laksa000
SPAM:0 17470852390149450600ateliervanneste.be532026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1852521870243887800atlas-belgie.be392026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6040530124344048200atletiekinfo.be412026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8766102895060801200aum-archi.be62026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7235487990710182200autoadvies.be112026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10010886980726644200autodemontageoverpelt.be212026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15450562561905231000auxcouleursdargiles.be552026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16920865701856655600avanguard.be782026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1274593998921222800baanbrekers2022.be142026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7013693855028491000babyfotostudio.be552026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:727 9507417563581509800baladane.be492026-01-22 02:10:162026-03-18 05:55:247272026-03-18 05:55:24laksa000
SPAM:0 1521327901160182600balmoderne.be132026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13037421899025402600barometredelisolation.be132026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1268513298215184600bastogne80.be232026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17270558424890825000bati-construct.be252026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:900 15270712258736277200bati-toit.be862026-01-13 07:00:512026-04-13 09:10:169002026-04-13 09:10:16laksa000
SPAM:0 12783546645086512400bcvillerswanze.be622026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 4744810638508183000beatricegerard.be152026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16276441888115098000beausens.be902026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 18140479322082343200begeo.be162026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17921496017969351400belcon.be572026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1971547917410298200bellaterra.be912026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8132234058295745400belselesportief.be272026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 9774468055847391800belstone.be592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7763626963455864200bespreking.be212026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3997194726576207600beta-nine.be382026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 283695747197603800betonmans.be192026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14961683185272638400betonvloerendelbaer.be922026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:969 6316993229448123600bevon.be182026-01-06 03:09:552026-04-13 09:10:169692026-04-13 09:10:16laksa000
SPAM:0 12088550475354958600biketour.be932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8865763906603764600bioservices.be232026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6960191129154791600blauwer.be582026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16108978292668094800blognome.be742026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7312597193578925800bngo.be292026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 16580429583732867800bobnoeyens.be392026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5151858089298669200bodhi.be462026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10395694998496660200bodyandbess.be12026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15448389741372917800boekuwhotel.be892026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6833488346617903000bokals.be152026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 4968531377956614200bombshellinfluencers.be712026-01-06 03:09:552026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 14207852136433122200bomlozeput.be112026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:818 13503039481846383600boogersairco.be182026-01-13 07:00:512026-03-18 05:55:248182026-03-18 05:55:24laksa000
SPAM:0 1340109788179577400bouillonp.be872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11593236255623195400bouwbar.be772026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17489641675002626600bouwcoordinatie.be332026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4728103355080028600bouwunieopdeafspraak.be432026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4607217121310746000bpu.be302026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16215667535650085600bracesbyorthigo.be282026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10037071552962749400brammer.be472026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4498124244268925600brighthouse.be282026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))