oceanofweb.com
robots.txt

Robots Exclusion Standard data for oceanofweb.com

Resource Scan

Scan Details

Site Domain oceanofweb.com
Base Domain oceanofweb.com
Scan Status Ok
Last Scan2025-02-26T05:48:52+00:00
Next Scan 2025-03-28T05:48:52+00:00

Last Scan

Scanned2025-02-26T05:48:52+00:00
URL https://oceanofweb.com/robots.txt
Domain IPs 103.212.120.133
Response IP 103.212.120.133
Found Yes
Hash ba4460e36b0758f7305344d95f98d4c0bb7febb7ed126724237a5c417ac0c84d
SimHash 6901eb744a16

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /go/
Disallow /*?*
Disallow /wp-*
Disallow /comments/feed/

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap http://www.oceanofweb.com/sitemap.xml
sitemap http://www.oceanofweb.com/sitemap-image.xml

Comments

  • disallow all files in these directories

Warnings

  • 8 invalid lines.