medium.co.id
robots.txt

Robots Exclusion Standard data for medium.co.id

Resource Scan

Scan Details

Site Domain medium.co.id
Base Domain medium.co.id
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-06T10:19:51+00:00
Next Scan 2024-10-13T10:19:51+00:00

Last Successful Scan

Scanned2024-09-28T10:19:22+00:00
URL https://medium.co.id/robots.txt
Domain IPs 192.250.235.31
Response IP 192.250.235.31
Found Yes
Hash 8b3f521e044091dfd288d5c4466815c3124f6ca2e100dfaca3a03f7a749f6bc6
SimHash ed0c2ce12594

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /src/
Disallow /?page=*
Disallow /*?page=*
Disallow /*?page=*&s=*
Disallow /*?page=*&feed=*
Disallow /*/*?page=*

Other Records

Field Value
sitemap https://portal.kincaimedia.net/sitemap.xml
sitemap https://portal.kincaimedia.net/sitemap-news.xml
sitemap https://portal.kincaimedia.net/rss.xml

Comments

  • Hello search engine
  • I am robots.txt
  • I am very happy to be crawled