🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 188 (from laksa130)

2. Crawled Status Check

Query:

Response:

{"found_url":"https:\/\/www.miti.gov.my\/","crawl_time":1776058458,"first_indexed_time":1528626703,"http_code":200,"src_unparsed":"my,gov,miti!www,\/ s443","src_root_hash":"14481224364799020188","history_drop_reason":null,"meta_title":"Ministry of Investment, Trade and Industry","meta_descriptions":["Kementerian Pelaburan, Perdagangan dan Industri"],"attrs_boilerpipe_text":"TINJAUAN: KESAN, TAHAP PENGGUNAAN DAN PEMATUHAN CPTPP\nSURVEY: CPTPP IMPACT, UTILISATION AND COMPLIANCE\nANUGERAH KECEMERLANGAN INDUSTRI\nINDUSTRY EXCELLENCE AWARD\nMAKLUMAT BERKAITAN PERJANJIAN PERDAGANGAN TIMBAL BALIK\nINFORMATION RELATED TO AGREEMENT ON RECIPROCAL TRADE\nMAKLUMAT BERKAITAN KERANGKA INSENTIF BAHARU\nINFORMATION RELATED TO NEW INCENTIVE FRAMEWORK\nLAMAN UTAMA PORTAL RASMI MITI\nMITI OFFICIAL PORTAL MAIN PAGE","attrs_markdown":"# Ministry of Investment, Trade and Industry\n|   |   |   |\n|---|---|---|\n| [![Malaysia's Goverment Logo](https:\/\/www.miti.gov.my\/miti\/resources\/user_1\/Layout%20Design%20-%20Deisgn%205\/Header%20Title\/jata-negara_v2.png)](https:\/\/www.miti.gov.my\/) | [![MITI's Portal](https:\/\/www.miti.gov.my\/miti\/resources\/titleheader_new-en.png)](https:\/\/www.miti.gov.my\/) |   |\n# ![banner](https:\/\/www.miti.gov.my\/miti\/resources\/landingpagebannerportal.jpg)\nSILA KLIK PAUTAN DI BAWAH UNTUK KOMUNIKASI YANG LEBIH CEPAT DAN PANTAS\n\n*PLEASE CLICK THE ICONS BELOW FOR A FASTER AND SPEEDY COMMUNICATION*\n\n|   |   |   |   |   |\n|---|---|---|---|---|\n| ![CPTPP-Survey](https:\/\/www.miti.gov.my\/miti\/resources\/CPTPP-Survey.PNG) **TINJAUAN: KESAN, TAHAP PENGGUNAAN DAN PEMATUHAN CPTPP**     *SURVEY: CPTPP IMPACT, UTILISATION AND COMPLIANCE* | ![safework](https:\/\/www.miti.gov.my\/miti\/resources\/aki2.png) **ANUGERAH KECEMERLANGAN INDUSTRI**     *INDUSTRY EXCELLENCE AWARD* | ![vtl land](https:\/\/www.miti.gov.my\/miti\/resources\/ART.png) **MAKLUMAT BERKAITAN PERJANJIAN PERDAGANGAN TIMBAL BALIK**     *INFORMATION RELATED TO AGREEMENT ON RECIPROCAL TRADE* | ![rcep](https:\/\/www.miti.gov.my\/miti\/resources\/NIF\/Front_Page-web_button_icon-NIF.png) **MAKLUMAT BERKAITAN KERANGKA INSENTIF BAHARU**     *INFORMATION RELATED TO NEW INCENTIVE FRAMEWORK* | ![portal](https:\/\/www.miti.gov.my\/miti\/resources\/user_1\/quick%20image\/jata-min.png) **LAMAN UTAMA PORTAL RASMI MITI**     *MITI OFFICIAL PORTAL MAIN PAGE* |\n\n[myGovernment](https:\/\/www.malaysia.gov.my\/)","attrs_readable_markdown":"|   |   |   |   |   |\n|---|---|---|---|---|\n| ![CPTPP-Survey](https:\/\/www.miti.gov.my\/miti\/resources\/CPTPP-Survey.PNG) **TINJAUAN: KESAN, TAHAP PENGGUNAAN DAN PEMATUHAN CPTPP** *SURVEY: CPTPP IMPACT, UTILISATION AND COMPLIANCE* | ![safework](https:\/\/www.miti.gov.my\/miti\/resources\/aki2.png) **ANUGERAH KECEMERLANGAN INDUSTRI** *INDUSTRY EXCELLENCE AWARD* | ![vtl land](https:\/\/www.miti.gov.my\/miti\/resources\/ART.png) **MAKLUMAT BERKAITAN PERJANJIAN PERDAGANGAN TIMBAL BALIK** *INFORMATION RELATED TO AGREEMENT ON RECIPROCAL TRADE* | ![rcep](https:\/\/www.miti.gov.my\/miti\/resources\/NIF\/Front_Page-web_button_icon-NIF.png) **MAKLUMAT BERKAITAN KERANGKA INSENTIF BAHARU** *INFORMATION RELATED TO NEW INCENTIVE FRAMEWORK* | ![portal](https:\/\/www.miti.gov.my\/miti\/resources\/user_1\/quick%20image\/jata-min.png) **LAMAN UTAMA PORTAL RASMI MITI** *MITI OFFICIAL PORTAL MAIN PAGE* |","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

3 hours ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.miti.gov.my/
Last Crawled	2026-04-13 05:34:18 (3 hours ago)
First Indexed	2018-06-10 10:31:43 (7 years ago)
HTTP Status Code	200
Meta Title	Ministry of Investment, Trade and Industry
Meta Description	Kementerian Pelaburan, Perdagangan dan Industri
Meta Canonical	null
Boilerpipe Text	TINJAUAN: KESAN, TAHAP PENGGUNAAN DAN PEMATUHAN CPTPP SURVEY: CPTPP IMPACT, UTILISATION AND COMPLIANCE ANUGERAH KECEMERLANGAN INDUSTRI INDUSTRY EXCELLENCE AWARD MAKLUMAT BERKAITAN PERJANJIAN PERDAGANGAN TIMBAL BALIK INFORMATION RELATED TO AGREEMENT ON RECIPROCAL TRADE MAKLUMAT BERKAITAN KERANGKA INSENTIF BAHARU INFORMATION RELATED TO NEW INCENTIVE FRAMEWORK LAMAN UTAMA PORTAL RASMI MITI MITI OFFICIAL PORTAL MAIN PAGE
Markdown	# Ministry of Investment, Trade and Industry \| \| \| \| \|---\|---\|---\| \| [![Malaysia's Goverment Logo](https://www.miti.gov.my/miti/resources/user_1/Layout%20Design%20-%20Deisgn%205/Header%20Title/jata-negara_v2.png)](https://www.miti.gov.my/) \| [![MITI's Portal](https://www.miti.gov.my/miti/resources/titleheader_new-en.png)](https://www.miti.gov.my/) \| \| # ![banner](https://www.miti.gov.my/miti/resources/landingpagebannerportal.jpg) SILA KLIK PAUTAN DI BAWAH UNTUK KOMUNIKASI YANG LEBIH CEPAT DAN PANTAS PLEASE CLICK THE ICONS BELOW FOR A FASTER AND SPEEDY COMMUNICATION \| \| \| \| \| \| \|---\|---\|---\|---\|---\| \| ![CPTPP-Survey](https://www.miti.gov.my/miti/resources/CPTPP-Survey.PNG) TINJAUAN: KESAN, TAHAP PENGGUNAAN DAN PEMATUHAN CPTPP SURVEY: CPTPP IMPACT, UTILISATION AND COMPLIANCE \| ![safework](https://www.miti.gov.my/miti/resources/aki2.png) ANUGERAH KECEMERLANGAN INDUSTRI INDUSTRY EXCELLENCE AWARD \| ![vtl land](https://www.miti.gov.my/miti/resources/ART.png) MAKLUMAT BERKAITAN PERJANJIAN PERDAGANGAN TIMBAL BALIK INFORMATION RELATED TO AGREEMENT ON RECIPROCAL TRADE \| ![rcep](https://www.miti.gov.my/miti/resources/NIF/Front_Page-web_button_icon-NIF.png) MAKLUMAT BERKAITAN KERANGKA INSENTIF BAHARU INFORMATION RELATED TO NEW INCENTIVE FRAMEWORK \| ![portal](https://www.miti.gov.my/miti/resources/user_1/quick%20image/jata-min.png) LAMAN UTAMA PORTAL RASMI MITI MITI OFFICIAL PORTAL MAIN PAGE \| [myGovernment](https://www.malaysia.gov.my/)
Readable Markdown	\| \| \| \| \| \| \|---\|---\|---\|---\|---\| \| ![CPTPP-Survey](https://www.miti.gov.my/miti/resources/CPTPP-Survey.PNG) TINJAUAN: KESAN, TAHAP PENGGUNAAN DAN PEMATUHAN CPTPP SURVEY: CPTPP IMPACT, UTILISATION AND COMPLIANCE \| ![safework](https://www.miti.gov.my/miti/resources/aki2.png) ANUGERAH KECEMERLANGAN INDUSTRI INDUSTRY EXCELLENCE AWARD \| ![vtl land](https://www.miti.gov.my/miti/resources/ART.png) MAKLUMAT BERKAITAN PERJANJIAN PERDAGANGAN TIMBAL BALIK INFORMATION RELATED TO AGREEMENT ON RECIPROCAL TRADE \| ![rcep](https://www.miti.gov.my/miti/resources/NIF/Front_Page-web_button_icon-NIF.png) MAKLUMAT BERKAITAN KERANGKA INSENTIF BAHARU INFORMATION RELATED TO NEW INCENTIVE FRAMEWORK \| ![portal](https://www.miti.gov.my/miti/resources/user_1/quick%20image/jata-min.png) LAMAN UTAMA PORTAL RASMI MITI MITI OFFICIAL PORTAL MAIN PAGE \|
Shard	188 (laksa)
Root Hash	14481224364799020188
Unparsed URL	my,gov,miti!www,/ s443