🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 26 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 16915491606711881600glassconstruction.az82026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14159351589597002200globalhost.az112026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11766233855961301400heavycrane.az72026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15772702178573564200hotelrunner.az212026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6356400738282942600iot.az132026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2764988218853564600labtest.az232026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6331420257307162600majesty.az132026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14202481207816781200primedmc.az62026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:909 14393928706542172200rean.az612026-01-06 03:09:552026-03-31 17:25:049092026-03-31 17:25:04laksa000
SPAM:950 9654204580559409400serverim.az472026-01-06 03:09:552026-04-13 09:10:169502026-04-13 09:10:16laksa000
SPAM:0 17713793698756052600technopark.az632026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:900 12654768360583396400tribune.az822026-02-03 06:27:312026-03-18 05:55:249002026-03-18 05:55:24laksa000
SPAM:1000 6520694390795652000yarimsan.az602026-03-18 05:55:242026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:700 16997019309319751800zevna.az592026-01-06 03:09:552026-03-24 07:10:187002026-03-24 07:10:18laksa000
SPAM:0 67726598844168606004falcons.ba32026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 11227046140548646400alex.ba322026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2071905217891783000app.ba152026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9598134983276677000asmservices.ba852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 315023882244825200baudecor.ba262026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2202296957526036600drugaosnovna.ba832026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 5920928682487641600euroizgradnja.ba82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:785 8545163592078551200fotodina.ba562026-01-06 03:09:552026-03-31 17:25:047852026-03-31 17:25:04laksa000
SPAM:0 2392264738961415800harrycooper.ba792026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 343292754144516000institutsk.ba802026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14466537479221702800juczosk.ba142026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8888819466029420800lipa.ba42026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 12999117365826510200macunmed.ba512026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:714 16822971663438340800memodesign.ba42026-01-06 03:09:552026-04-13 09:10:167142026-04-13 09:10:16laksa000
SPAM:700 2402666099678228000more.ba402026-01-06 03:09:552026-04-13 09:10:167002026-04-13 09:10:16laksa000
SPAM:680 3105680367932793000neuros.ba652026-01-06 03:09:552026-03-31 17:25:046802026-03-31 17:25:04laksa000
SPAM:666 6918880160760760200nevadkahteran.ba12026-04-13 09:10:162026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:0 8007688260995730800progress.ba542026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13670707193997245200sab.ba262026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:900 15786763775392246200sajam.ba312026-01-13 07:00:512026-03-24 07:10:189002026-03-24 07:10:18laksa000
SPAM:0 16047143092308772000sonar.ba602026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15437690122479818200wireless.ba912026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7204209219507122000020.baby102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 11143642136720012600berkah303-gacor.baby632026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 12060692280064732400bokebind.baby622026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 17205541228998630600direktur4d.baby532026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 8403601720819293800helen.baby692026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 5074594036466621600kyt4d.baby82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4123728174112801400nuhunslot.baby72026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 13224162578177433200phimmoii.baby662026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 14854749904042432800tal.baby642026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 1184842598833441800tinycat99.baby92026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 3288669805744202400udewamp25.baby122026-01-22 02:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:903 6045295255791013200vlxx1.baby662026-03-18 05:55:242026-04-13 09:10:169032026-04-13 09:10:16laksa000
SPAM:0 8185843882042068400xa.baby422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:750 17420990289298870600duckbomb.band532026-03-24 07:10:182026-04-13 09:10:167502026-04-13 09:10:16laksa000
SPAM:916 2172794356667407200filler.band362026-04-13 09:10:162026-04-13 09:10:169162026-04-13 09:10:16laksa000
SPAM:1000 16281530879652620800parlay188.band42026-03-18 05:55:242026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 1814815166630453600plural.band682026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6992915743899180400roomservice.band22026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3348415014919316000thedrive.band802026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:1000 17012846827093213000vuabet.band652026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 13450921507604889000031.bar452026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 52460433451359140068win.bar572026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 8517430531630485800casinoandyou-90178.bar292026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 9491663121374443000instapro.bar152026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:1000 6663430262878578000omg138-amp.bar902026-03-24 07:10:182026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 3415650015116412200pgwallet.bar612026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 5179606763393975400taptap.bar772026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8454460577146966800see.barcelona342026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16917214318685731400carbon.bayern572026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17780313858987197400dr-forster.bayern872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12323439738312383600schreinerei-aumüller.bayern182026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5981685428700872400sas.ac.bd622026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15611717949710610800aies.com.bd542026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 14089483430557013000akhp.com.bd652026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:833 2146152599274668600ayaanmart.com.bd432026-01-06 03:09:552026-04-13 09:10:168332026-04-13 09:10:16laksa000
SPAM:862 3319702952697233200bestnews.com.bd662026-01-06 03:09:552026-04-13 09:10:168622026-04-13 09:10:16laksa000
SPAM:1000 3504509266799758400ghorket.com.bd922026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:818 8045461789341192800hasty.com.bd642026-03-18 05:55:242026-03-31 17:25:048182026-03-31 17:25:04laksa000
SPAM:0 14969438915540814800ozy.com.bd742026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8761905459640025800shukranfoods.com.bd292026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 9754034518134620400skyranko.com.bd22026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 2207963324485624800telco.com.bd242026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 9790524892510227000voktis.com.bd352026-01-22 02:10:162026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 17271806607636115200bstc.edu.bd762026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 1573218449630137800comc.edu.bd892026-02-03 06:27:312026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:1000 11539298316801640400dhabalsatihs.edu.bd22026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 14077436862561434800gnhsc.edu.bd742026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:705 15573872392382898600kmuhighschool.edu.bd932026-01-13 07:00:512026-04-13 09:10:167052026-04-13 09:10:16laksa000
SPAM:777 3533837857685792000pabnagci.edu.bd602026-01-06 03:09:552026-03-31 17:25:047772026-03-31 17:25:04laksa000
SPAM:944 13147387342148097600psac.edu.bd882026-01-13 07:00:512026-04-13 09:10:169442026-04-13 09:10:16laksa000
SPAM:975 16181722220576169000ruppurghs.edu.bd452026-01-06 03:09:552026-04-13 09:10:169752026-04-13 09:10:16laksa000
SPAM:0 3305468551297422000rus.edu.bd102026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:800 1962044940090081200samantasarss.edu.bd62026-03-31 17:25:042026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:769 13634641519375182000sbhschool.edu.bd102026-01-06 03:09:552026-04-13 09:10:167692026-04-13 09:10:16laksa000
SPAM:840 9219163333935247600cafoland.gov.bd382026-03-24 07:10:182026-04-13 09:10:168402026-04-13 09:10:16laksa000
SPAM:833 1327372977300535400cafowomenchild.gov.bd772026-01-06 03:09:552026-04-13 09:10:168332026-04-13 09:10:16laksa000
SPAM:0 16433988197359805000imtchandpur.gov.bd252026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 2973074046975935800acn.net.bd792026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:900 6581227144582705200shafienterprise.net.bd262026-03-18 05:55:242026-03-18 05:55:249002026-03-18 05:55:24laksa000
SPAM:0 15523020985010975200123velo.be762026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14473831347782027400125jaarkusttram.be372026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 92347696139010346001500netto.be732026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 174784158802525924001788.be622026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:909 71368148112115926002-execute.be632026-01-06 03:09:552026-03-31 17:25:049092026-03-31 17:25:04laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))