webdiyo.com
robots.txt

Robots Exclusion Standard data for webdiyo.com

Resource Scan

Scan Details

Site Domain webdiyo.com
Base Domain webdiyo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-10T04:33:34+00:00
Next Scan 2025-12-10T04:33:34+00:00

Last Successful Scan

Scanned2025-10-11T16:49:56+00:00
URL https://webdiyo.com/robots.txt
Domain IPs 104.21.49.96, 172.67.189.188, 2606:4700:3034::6815:3160, 2606:4700:3034::ac43:bdbc
Response IP 172.67.189.188
Found Yes
Hash b4c3950758870af5af8e33566769cf440888b262a0b52ab48b58b857cbb3eb44
SimHash 2d5cd668632d

Groups

*

Rule Path
Disallow /captcha.php
Disallow /modcp.php
Disallow /moderation.php
Disallow /printthread.php
Disallow /task.php
Disallow /archive/
Disallow /online.php
Disallow /calendar.php
Disallow /reputation.php
Disallow /*nextoldest*
Disallow /*nextnewest*
Disallow /*datecut*
Disallow /*lastpost*
Disallow /*markread*
Disallow /ratethread.php
Disallow /report.php
Disallow /sendthread.php*
Disallow /usercp.php*
Disallow /usercp2.php*
Disallow /newreply.php*
Disallow /newthread.php*
Disallow /editpost.php
Disallow /private.php
Disallow /search.php
Disallow /memberlist.php
Disallow /showteam.php
Disallow /stats.php
Disallow /showratings.php
Disallow /syndication.php*
Disallow /misc.php
Disallow /*sortby*
Disallow /*action%3Demailuser*
Disallow /*action%3Dnextnewest*
Disallow /*action%3Dnextoldest*
Disallow /*year%3D*
Disallow /*action%3Dweekview*
Disallow /*action%3Dnextnewest*
Disallow /*action%3Dnextoldest*
Disallow /*sort%3D*
Disallow /*order%3D*
Disallow /*mode%3D*
Disallow /*datecut%3D*
Disallow /usuario-*?action=emailuser
Disallow /ratethread.php
Disallow /attachment.php

mediapartners-google

Rule Path
Allow /

dotbot

Rule Path
Disallow /

Warnings

  • 3 invalid lines.