m.kumparan.com
robots.txt

Robots Exclusion Standard data for m.kumparan.com

Resource Scan

Scan Details

Site Domain m.kumparan.com
Base Domain kumparan.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-02T06:03:20+00:00
Next Scan 2024-07-31T06:03:20+00:00

Last Successful Scan

Scanned2023-06-15T05:53:58+00:00
URL https://m.kumparan.com/robots.txt
Redirect https://kumparan.com/robots.txt
Redirect Domain kumparan.com
Redirect Base kumparan.com
Domain IPs 104.18.129.231, 104.18.130.231, 2606:4700::6812:81e7, 2606:4700::6812:82e7
Redirect IPs 104.18.129.231, 104.18.130.231, 2606:4700::6812:81e7, 2606:4700::6812:82e7
Response IP 104.18.130.231
Found Yes
Hash 315fad5aaade7226ceb50c7979b0ece32f5e78a0fcf5afa928974bf3726e5039
SimHash 68505cb36653

Groups

twitterbot

Rule Path
Allow *

googlebot-image

Rule Path
Allow *
Allow /

*

Rule Path
Allow /.well-known/amphtml/apikey.pub

Other Records

Field Value
sitemap https://kumparan.com/sitemap.xml
sitemap https://kumparan.com/sitemap_basic.xml
sitemap https://kumparan.com/sitemap_image.xml
sitemap https://kumparan.com/sitemap_video.xml
sitemap https://kumparan.com/sitemap_channels.xml
sitemap https://kumparan.com/sitemap_imsak_schedules.xml
sitemap https://kumparan.com/sitemap_channel_news.xml
sitemap https://kumparan.com/sitemap_channel_entertainment.xml
sitemap https://kumparan.com/sitemap_channel_mom.xml
sitemap https://kumparan.com/sitemap_channel_food-travel.xml
sitemap https://kumparan.com/sitemap_channel_tekno-sains.xml
sitemap https://kumparan.com/sitemap_channel_otomotif.xml
sitemap https://kumparan.com/sitemap_channel_woman.xml
sitemap https://kumparan.com/sitemap_channel_bola-sports.xml
sitemap https://kumparan.com/sitemap_channel_bisnis.xml
sitemap https://kumparan.com/sitemap_channel_buzz.xml
sitemap https://kumparan.com/sitemap_channel_bolanita.xml
sitemap https://kumparan.com/sitemap_collection.xml