🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 23 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 6864347288999165400pentanastantonlawyers.com.au272026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:977 8687574272515636000pestcontrolbeenleigh.com.au802026-01-06 03:09:552026-04-13 09:10:169772026-04-13 09:10:16laksa000
SPAM:0 16686249578558404000pilatesmoves.com.au202026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9997475076491388400pinballfactory.com.au422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1600041436756524400platinumgraphicsqld.com.au222026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4655095814915972600platinumprojects.com.au632026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7165679200384619400pomanda.com.au972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1210012427142381600poochandco.com.au82026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:930 12444393732606793800portmacquarieproperty.com.au692026-01-06 03:09:552026-04-13 09:10:169302026-04-13 09:10:16laksa000
SPAM:0 5038843689459520000premiersmsf.com.au02026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 851490945141836600priority.com.au832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 4297923096546505800prizedpcs.com.au292026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 3974983498121750800problemchild.com.au542026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 788992976111091000propertymarketer.com.au552026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13561885142651717600proplusplumbing.com.au882026-02-17 04:56:342026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 11497397326913433600purebrilliance.com.au682026-01-13 07:00:512026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 4659740728012940200qdi.com.au12026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 9678776239373794200qrcprojects.com.au712026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 286845439329556000qualitysaleslink.com.au802026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7934374059301622000quantumfiltration.com.au102026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 12053670378403514200queensbeachtouristvillage.com.au712026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10049723496251198800questmascot.com.au942026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14934839992538943400questonstorybridge.com.au172026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11736489472151639000radioactive.com.au952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:956 3714149971240470400raeair.com.au522026-01-06 03:09:552026-04-13 09:10:169562026-04-13 09:10:16laksa000
SPAM:0 8305353515653875000railsafetyconference.com.au752026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15889456521536652000ravn.com.au602026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11946631008086014400raywhitecommercialnoosa.com.au722026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 16985345301302511200razpainting.com.au562026-01-22 02:10:162026-03-24 07:10:187002026-03-24 07:10:18laksa000
SPAM:0 13242157599382910800reactiveplumbers.com.au542026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13234051049127890400realmatch.com.au522026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6960233270663292400realpsychology.com.au622026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 214790696489990800recruitmentunited.com.au542026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16522192095301929400renovationplanning.com.au472026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3375898377367565400researchaustralia.com.au272026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17869940587464491400rgmdarwin.com.au572026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8868958507453417800rgslaw.com.au892026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12519676746784954400rhinolures.com.au722026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11557546845830934400ripclear.com.au722026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12395275373937983600risingwise.com.au182026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4987126223974126600s16.com.au332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4579094959691764000sacredtravels.com.au202026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:909 4904625599016799800saffronbiz.com.au992026-01-13 07:00:512026-03-18 05:55:249092026-03-18 05:55:24laksa000
SPAM:0 9313773243948423200salonr.com.au162026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:800 7358903623280660200samedaycarpetcleaningwhittlesea.com.au12026-03-18 05:55:242026-03-18 05:55:248002026-03-18 05:55:24laksa000
SPAM:0 348114331545857400sandiwoo.com.au872026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 7002836959344572800sarahmorton.com.au642026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1432242113971167800sbu.com.au392026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17532880683965441000scarletlady.com.au52026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14955615434592184200scenicworldtickets.com.au212026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15419726586595643400scottking.com.au172026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:866 9532596013760434600scottlaw.com.au732026-01-06 03:09:552026-03-18 05:55:248662026-03-18 05:55:24laksa000
SPAM:0 3315205408263324000seasideki.com.au202026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16621394131997850600seauto.com.au532026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7913463529264518800seecoaching.com.au942026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11367095255198409200seedandsprout.com.au462026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 1622290820505851800seethesound.com.au592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:866 7910385017148814000seeyououtthere.com.au702026-01-13 07:00:512026-04-13 09:10:168662026-04-13 09:10:16laksa000
SPAM:769 9152239728754888600sefe.com.au432026-01-06 03:09:552026-04-13 09:10:167692026-04-13 09:10:16laksa000
SPAM:0 3405745393026095400seosydneyservices.com.au772026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 327839008186734000sevenmileinn.com.au702026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7390127820603089200sevenrooms.com.au462026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6042820337809376200seymoursgroup.com.au812026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3897458944331884800shearerhomes.com.au242026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13712197903894670600sheart.com.au532026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17604087950086461200sheffieldwire.com.au62026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10412581914879649600shippingcontainersjimboomba.com.au482026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7996663404927765800shippingcontainerskingaroy.com.au292026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7236665164979182000shoemovers.com.au102026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9492918729595076600sidelife.com.au832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11626690095189226600sigratech.com.au332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9606960416260090200sigriddenehey.com.au512026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15668111274290770200sizewise.com.au512026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17582956616812688400skittlelane.com.au422026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 1889573451994824400skunkworx.com.au222026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2966069410457838800smsf-westpac.com.au942026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13342089802574117600snuggo.com.au882026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 3016426590107102400social-marketing.com.au122026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16960999453571965800socialmediaaok.com.au292026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2927538734858135400soireecabaret.com.au772026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15783685090120460600solarisestate.com.au32026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17379930662845307600sparkbright.com.au382026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 13725667216144981800spcfinance.com.au92026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6771441533596578000speakr.com.au902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13587590975371620400spectrumfireworks.com.au22026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15667453093251548400speediemechanical.com.au422026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9006941100198675000sportrackr.com.au752026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10273111662745404400spreflexology.com.au222026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10119040376364861400sprinklescleaningservices.com.au72026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4364926103438512400sscleaningservices.com.au622026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1738307630056081800steammclean.com.au92026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15308230640802184800stillwateratcrittenden.com.au242026-02-10 04:07:202026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 14137713041512732400stiparts.com.au622026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1953206146007897600strasburgs.com.au882026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:934 7919889363021169600strength.com.au482026-01-06 03:09:552026-04-13 09:10:169342026-04-13 09:10:16laksa000
SPAM:0 2341764815541820800strongwithstef.com.au42026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17106150979125008000studio8cd.com.au402026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 260479679929708200stumpingmelbourne.com.au412026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1794986143413966600stylco.com.au332026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16858805476811955200sunshinecoastearlylearning.com.au762026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))