berbidserver.com
robots.txt

Robots Exclusion Standard data for berbidserver.com

Resource Scan

Scan Details

Site Domain berbidserver.com
Base Domain berbidserver.com
Scan Status Ok
Last Scan2025-03-23T17:54:18+00:00
Next Scan 2025-04-22T17:54:18+00:00

Last Scan

Scanned2025-03-23T17:54:18+00:00
URL https://berbidserver.com/robots.txt
Domain IPs 104.21.45.101, 172.67.213.34, 2606:4700:3034::6815:2d65, 2606:4700:3037::ac43:d522
Response IP 172.67.213.34
Found Yes
Hash bcc4f7945e14dd62b1971a8dfbe3cbdd7edff4d71cd51137770f4f73261bad8d
SimHash 6028c860cd90

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow *?p=*
Disallow /404/
Disallow /*.html$
Disallow /?b=
Disallow /shopping/
Disallow /commodity/

Other Records

Field Value
sitemap https://berbidserver.com/sitemap.xml
sitemap https://berbidserver.com/sitemap.rss