🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 20 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 13034359474376891800ckmassage.com.au592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11064597219611001400clarewatsonva.com.au72026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9149358614584591600classicandprestige.com.au582026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7403794617282415200clh.com.au762026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 7003850650664860400cloud-secure.com.au22026-02-10 04:07:202026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:960 4829476236969429600clydesupportservices.com.au482026-01-06 03:09:552026-04-13 09:10:169602026-04-13 09:10:16laksa000
SPAM:0 7244546026066394200cnlandscaping.com.au712026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17949755772961441000coachwood.com.au52026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8243466189963707000coastalrecruitment.com.au352026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:880 11199818035965586200colourdecor.com.au312026-01-06 03:09:552026-04-13 09:10:168802026-04-13 09:10:16laksa000
SPAM:0 14669345789658739600coloursofsydney.com.au982026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8178287302669859200computersnow.com.au962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17135154886235694400conferencesystems.com.au722026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6228474147412080200connecttourism.com.au12026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3665815613755669000connellysofficenational.com.au452026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 4308546762160265800cooneys.com.au292026-02-03 06:27:312026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 5210293314438489200corfocus.com.au462026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7845717695056680400cosmeticsurgery.com.au22026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13687352038308433800cosmocafe.com.au692026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 2928212040564260000cpsmcare.com.au02026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8897702528253186000cqfis.com.au302026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13587223207408033200crearte.com.au662026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15077710554527512800creativedp.com.au642026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 347831616108076400csjhomes.com.au822026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15484126334000919400cycho.com.au972026-01-14 03:13:162026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:695 16115423298692816000czlink.com.au802026-03-18 05:55:242026-03-18 05:55:246952026-03-18 05:55:24laksa000
SPAM:0 7984550287006153800daburger.com.au692026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7033659948406432400danielthepainter.com.au622026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13980641330807479400dansol.com.au972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5110519995385413600dashsystems.com.au682026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2866303235921758200dbidesign.com.au912026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3133432428075096000dcaas.com.au802026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 16182542822851287200dcwindowtinting.com.au362026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:705 11691180000505978400deanhomicki.com.au922026-02-03 06:27:312026-03-24 07:10:187052026-03-24 07:10:18laksa000
SPAM:800 9029642676432424800deluxemodels.com.au242026-03-31 17:25:042026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:0 2658161391291757400delvue.com.au872026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 8729931705946174400diadem.com.au722026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:833 6860636166382055800diamondcommercialcleanersbrisbane.com.au792026-03-18 05:55:242026-03-18 05:55:248332026-03-18 05:55:24laksa000
SPAM:812 13523085722707760400digiantler.com.au22026-03-18 05:55:242026-03-31 17:25:048122026-03-31 17:25:04laksa000
SPAM:0 13358934332036443800digitalbarn.com.au192026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14084441624802066600digitalhearing.com.au332026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3329765627005455600disneymobile.com.au782026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18085339836829086000divergenttechnologies.com.au302026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10966181482825566800diversewebdesigns.com.au342026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17435901532817439200drandrewsouth.com.au962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12896534171699969800dreamstone.com.au492026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14879586761306129400drfbuilders.com.au472026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8990331433272968000dropshipit.com.au402026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17520697477232218200ductedvacuumcentre.com.au912026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16969297278553173800dunamisadvisory.com.au692026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6534795428029866600dynamicdisability.com.au332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7880285277981538000eaglemedia.com.au902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14877018914627405800eaglestationers.com.au292026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 818352242906363800earlies.com.au192026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16494927749765530200earthpulls.com.au512026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 5154540146465378200easyroo.com.au912026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7670280532848193000eclicks.com.au652026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 3621409732633500600ecoenergyqld.com.au32026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8474312229369064200edenparkestate.com.au212026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 505070805569103200edisonlane.com.au162026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 4771949776532762000electrical-design.com.au102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15783865638842355400embeddedsolutions.com.au772026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3065456355303926600emilyziz.com.au332026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12956813040629935800employmentstar.com.au792026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:920 8076322195845045400endstate.com.au272026-01-06 03:09:552026-04-13 09:10:169202026-04-13 09:10:16laksa000
SPAM:0 3097231888383841800enlaircon.com.au92026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7196757122656434000enviroheat.com.au702026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4515355563548824800epmpest.com.au242026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14840374180184058000equineautotrainer.com.au902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1908650915966660800erosionps.com.au42026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 9136242077326662600escservices.com.au132026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17069757648208939000essentialhealthnaturopathy.com.au952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16293205791809068400evhotel.com.au422026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8904850308473261200evolveman.com.au62026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8229123364720553800excitelogistics.com.au692026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6928650755811583600exitcompanion.com.au182026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:833 3226473993411003800expandpromotion.com.au192026-02-03 06:27:312026-03-18 05:55:248332026-03-18 05:55:24laksa000
SPAM:0 12066747806849140600firstaidcoursebrisbane.com.au32026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7099503806090386200firstedu.com.au312026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8083463568416278800fittopia.com.au942026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14348231051361441800flagstaffpower.com.au92026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:760 13970991117094898400flamincode.com.au922026-03-18 05:55:242026-04-13 09:10:167602026-04-13 09:10:16laksa000
SPAM:0 11940950098212728200flashdisplays.com.au412026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10883949808896323400flindersmines.com.au172026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8502086125034010600flyingheart.com.au532026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16948205001604936800fmacasting.com.au842026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10374446027238250400focusprivatewealth.com.au522026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16259256947098690400footshop.com.au522026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4771609749246392200foxinthecorn.com.au612026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 3324842780133462800freshmeals2u.com.au142026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1300680185331571400freshwaterit.com.au572026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15942059988675733600friendsonstan.com.au682026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 2814647798605793800frt.com.au692026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13857109567278028000fullspectrumtutoring.com.au402026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:928 449924057255886800funkyfelt.com.au342026-01-06 03:09:552026-04-13 09:10:169282026-04-13 09:10:16laksa000
SPAM:0 3386249974388596800futuristitsolutions.com.au842026-01-14 03:13:162026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 1457312016963507200galdan.com.au362026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10547856076284643400gamesonline.com.au172026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5702350219762711200gatewayfinancial.com.au562026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14332715891274568200gclef.com.au412026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))