superprof.co.id
robots.txt

Robots Exclusion Standard data for superprof.co.id

Resource Scan

Scan Details

Site Domain superprof.co.id
Base Domain superprof.co.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-15T16:47:27+00:00
Next Scan 2024-09-29T16:47:27+00:00

Last Successful Scan

Scanned2024-08-08T04:22:57+00:00
URL https://superprof.co.id/robots.txt
Redirect https://www.superprof.co.id/robots.txt
Redirect Domain www.superprof.co.id
Redirect Base superprof.co.id
Domain IPs 108.157.254.50, 108.157.254.63, 108.157.254.95, 108.157.254.98, 2600:9000:2753:0:b:5c9f:6fc0:93a1, 2600:9000:2753:1800:b:5c9f:6fc0:93a1, 2600:9000:2753:2a00:b:5c9f:6fc0:93a1, 2600:9000:2753:3800:b:5c9f:6fc0:93a1, 2600:9000:2753:800:b:5c9f:6fc0:93a1, 2600:9000:2753:8a00:b:5c9f:6fc0:93a1, 2600:9000:2753:9a00:b:5c9f:6fc0:93a1, 2600:9000:2753:b200:b:5c9f:6fc0:93a1
Redirect IPs 108.157.254.50, 108.157.254.63, 108.157.254.95, 108.157.254.98, 2600:9000:2753:6a00:b:5c9f:6fc0:93a1, 2600:9000:2753:7c00:b:5c9f:6fc0:93a1, 2600:9000:2753:8800:b:5c9f:6fc0:93a1, 2600:9000:2753:9000:b:5c9f:6fc0:93a1, 2600:9000:2753:9e00:b:5c9f:6fc0:93a1, 2600:9000:2753:ac00:b:5c9f:6fc0:93a1, 2600:9000:2753:da00:b:5c9f:6fc0:93a1, 2600:9000:2753:ec00:b:5c9f:6fc0:93a1
Response IP 108.157.254.95
Found Yes
Hash 04596a161533469dc8f5199244dd91c2f75ae3656956b552cad067f05d196fed
SimHash 4a14591cc993

Groups

*

Rule Path
Disallow /koneksi-*
Disallow /dasbor*
Disallow /lib/
Disallow /ajax/
Disallow /a/
Disallow /blog/?s=*
Disallow /blog/?wordfence_lh=*

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.superprof.co.id/sitemap.xml
sitemap https://www.superprof.co.id/blog/sitemap.xml