sstiktok.id
robots.txt

Robots Exclusion Standard data for sstiktok.id

Resource Scan

Scan Details

Site Domain sstiktok.id
Base Domain sstiktok.id
Scan Status Ok
Last Scan2024-09-16T05:40:19+00:00
Next Scan 2024-09-23T05:40:19+00:00

Last Scan

Scanned2024-09-16T05:40:19+00:00
URL https://sstiktok.id/robots.txt
Domain IPs 104.21.17.81, 172.67.175.79, 2606:4700:3031::6815:1151, 2606:4700:3034::ac43:af4f
Response IP 104.21.17.81
Found Yes
Hash 8e31786f67d2f025757bbc327df06a32e121894b9f6e8542a2651e53361de905
SimHash 6848d9915117

Groups

googlebot

Rule Path
Disallow

slurp

Rule Path
Disallow

msnbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

*

Rule Path
Disallow
Allow /

Other Records

Field Value
sitemap https://sstiktok.id/sitemap.xml