scribddownloader.id
robots.txt

Robots Exclusion Standard data for scribddownloader.id

Resource Scan

Scan Details

Site Domain scribddownloader.id
Base Domain scribddownloader.id
Scan Status Ok
Last Scan2025-12-12T23:51:25+00:00
Next Scan 2025-12-19T23:51:25+00:00

Last Scan

Scanned2025-12-12T23:51:25+00:00
URL https://scribddownloader.id/robots.txt
Domain IPs 104.21.42.178, 172.67.164.40, 2606:4700:3030::6815:2ab2, 2606:4700:3037::ac43:a428
Response IP 172.67.164.40
Found Yes
Hash b038caf5755fc39b888d87f2753b0b97c44fd3459ffe806b5384b4af4ee87c81
SimHash e808d80889b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /feed/
Disallow /*/feed/
Disallow /comments/feed/
Disallow /?s=
Disallow /search/

Other Records

Field Value
sitemap https://scribddownloader.id/sitemap_index.xml