🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 25 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 16919887807704204200lvc.au212026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 18015896866095245800murraygroup.au292026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15647412667034851800mywebsite.au592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 171591981248495292001800tools4u.net.au462026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4577704889570935600answer.net.au782026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9571876068496694000australianenglish.net.au702026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:800 9411326803150091400australianpodiatryclinics.net.au572026-01-06 03:09:552026-03-31 17:25:048002026-03-31 17:25:04laksa000
SPAM:0 9624794086274485800carbuyersguide.net.au292026-02-17 04:56:342026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 10047844272075228200dentalimplantsolutions.net.au412026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4686722855894146000fdi.net.au302026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 9563863336127484600frogonline.net.au232026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 9250825486501351200goau.net.au562026-01-06 03:09:552026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 10713598448111332800highsteel.net.au642026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 6350087589346556600landvehiclespares.net.au832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1318842857513452200lsp.net.au612026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2689749139109061800mobifix.net.au92026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:812 8608614064223918400myfin.net.au922026-02-03 06:27:312026-04-13 09:10:168122026-04-13 09:10:16laksa000
SPAM:0 12391206012253885400omex.net.au272026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5007376320728523000petstuff.net.au152026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14995262398120626600pharmacy4less.net.au332026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5828058954501539200plumbervictoriapoint.net.au962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:900 110749049644935400rosenbergs.net.au772026-03-18 05:55:242026-04-13 09:10:169002026-04-13 09:10:16laksa000
SPAM:0 5545338914137042800sla.net.au142026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15179201264217428000smartphonez.net.au402026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3968233585256205400tradex.net.au272026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 2992169219332683800tweak.net.au192026-01-14 03:13:162026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 8295403123575026800xtreme.net.au342026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17577934446962077400nineridges.au872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1309277102859227800noove.au392026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 13283684151555453200akata.org.au662026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8161569129764655200autoapprenticeships.org.au762026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 864844673647385800bedbug.org.au292026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 5222039479838936000canningstockroute.org.au802026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1658672549162626400canterburybaptist.org.au322026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17929784853162908400decembeard.org.au422026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 1734338333811360000dgtvision.org.au02026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1910327481725498800dlnsw.org.au942026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3129561036049237600dunedoo.org.au882026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2751516295171468400fcf.org.au422026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 11066173476534783400fcs.org.au172026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15447931680042600400foodreliefnq.org.au22026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 13374134033520570200goodmedicalpractice.org.au512026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:920 11213229620304163800hhcma.org.au192026-01-14 03:13:162026-04-13 09:10:169202026-04-13 09:10:16laksa000
SPAM:0 9219784485376995400hphc.org.au772026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 2193024633851130200idss.org.au512026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 8552788450051117600kynetonsbrc.org.au882026-02-17 04:56:342026-03-18 05:55:247002026-03-18 05:55:24laksa000
SPAM:0 1688070162600018600marketplace.org.au932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7823916928113402800mychurch.org.au142026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 15660374978419788600nbswe.org.au432026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 12249993571080148200noosavillebusinessassociation.org.au412026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:692 9525824422760537000northamaeroclub.org.au852026-01-13 07:00:512026-04-13 09:10:166922026-04-13 09:10:16laksa000
SPAM:0 16417138266112435000shared.org.au752026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 12067455824578540200stanton.org.au12026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2293744921818479200stmstl.org.au962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17486574866366181400stpaulsglenelg.org.au72026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1084351561293952400taralye.org.au622026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 125926085252512200ttws.org.au612026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11572147673428049400u3awarwick.org.au472026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16125621130289245800uselectionwatch.org.au292026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17933324120834520400vhpwa.org.au22026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:695 11520209337389543600yourcarenavigator.org.au182026-03-18 05:55:242026-03-18 05:55:246952026-03-18 05:55:24laksa000
SPAM:0 5479747495099611200parc.au562026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 2979208373236384800pixelloom.au242026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 12369875873039851800promotionalproductsnow.au592026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6486162720203246600railmaps.au332026-01-14 03:13:162026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 5183965599566007200senx.au362026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 6018352044205329400shippingcontainersale.au472026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2052549007111837800thegiftgirls.au892026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18017755280304721000trademarkhomes.au52026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:652 18237053670093685000unitedhealth.au252026-02-10 04:07:202026-04-13 09:10:166522026-04-13 09:10:16laksa000
SPAM:720 16532244591202899800wildthing.au992026-01-13 07:00:512026-04-13 09:10:167202026-04-13 09:10:16laksa000
SPAM:0 17800019754339814400yourhub.au722026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3718547555275610800attachments.auction542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 4066360993778737800mert.audio892026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 8414853528392122600cox.auto132026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 13553718399062232400aw8.autos622026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:980 14130968984596749000camiones.autos452026-01-06 03:09:552026-04-13 09:10:169802026-04-13 09:10:16laksa000
SPAM:981 11746870724005561200crackerbarrelsurvey.autos62026-01-06 03:09:552026-04-13 09:10:169812026-04-13 09:10:16laksa000
SPAM:0 5043130738122183000cuan123-rtp05.autos152026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 16914210142095226400iklangame.autos322026-03-18 05:55:242026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:1000 5502041588837851800kokogaming.autos592026-03-18 05:55:242026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:1000 8609825654751583400kristal777-cuan.autos172026-03-18 05:55:242026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 2323534040179937400menangnemo.autos872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 18268854716444656200sip33best.autos812026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 1265223686332716600squeen668.autos832026-01-13 07:00:512026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:0 15275423332747554200techbolt.autos712026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:733 16157656156476073400tsclistens.autos672026-03-24 07:10:182026-04-13 09:10:167332026-04-13 09:10:16laksa000
SPAM:0 20564474557908000vavaslot88-014.autos402026-02-03 06:27:312026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 8422445772926049800xxx.autos492026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 3651475884525645200zigum.autos262026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 10639302830987612000komforthus.ax602026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8575743699183068200mecax.ax412026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1438603543671400avtopart.az572026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:846 18286970039930892800azco.az642026-01-06 03:09:552026-03-31 17:25:048462026-03-31 17:25:04laksa000
SPAM:0 12834975265351284400bakhbele.az222026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15249181871964162800bamagro.az142026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3179616109906194400doculand.az722026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:931 550483193192515200ecohub.az762026-02-03 06:27:312026-04-13 09:10:169312026-04-13 09:10:16laksa000
SPAM:0 11069252303606962000evergreen.az102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11951416841596484600fagorservis.az232026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))