realadvicegal.com
robots.txt

Robots Exclusion Standard data for realadvicegal.com

Resource Scan

Scan Details

Site Domain realadvicegal.com
Base Domain realadvicegal.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-05T11:54:13+00:00
Next Scan 2024-12-04T11:54:13+00:00

Last Successful Scan

Scanned2024-08-07T11:53:15+00:00
URL https://realadvicegal.com/robots.txt
Domain IPs 23.111.179.26
Response IP 23.111.179.26
Found Yes
Hash 7b38cfe1fbe1db943b29615be8ae3eb60c4201332e244170c7a5ba80c5c48136
SimHash 61104bead2fd

Groups

mj12bot*

Rule Path
Disallow /

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

*

Rule Path
Disallow /cgi-bin/
Disallow /recommended/
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php

Other Records

Field Value
crawl-delay 60