mobifriends.com
robots.txt

Robots Exclusion Standard data for mobifriends.com

Resource Scan

Scan Details

Site Domain mobifriends.com
Base Domain mobifriends.com
Scan Status Ok
Last Scan2024-11-13T14:58:58+00:00
Next Scan 2024-11-20T14:58:58+00:00

Last Scan

Scanned2024-11-13T14:58:58+00:00
URL https://mobifriends.com/robots.txt
Redirect https://www.mobifriends.com/robots.txt
Redirect Domain www.mobifriends.com
Redirect Base mobifriends.com
Domain IPs 104.20.13.82, 104.20.14.82
Redirect IPs 104.20.13.82, 104.20.14.82
Response IP 104.20.14.82
Found Yes
Hash ed2893d259d1f59a2a5c72cd77e0e2ea11499df805ee1996ad8c39a3e022ea64
SimHash 5d160d91e1f5

Groups

*

Rule Path
Disallow /php/
Disallow /chat/
Disallow /admin/
Disallow /futuro/
Disallow /logs/
Disallow /old/
Disallow /old2/
Disallow /seo2/application/controllers/administracion
Disallow /clicktale/
Disallow /wap/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

imagesiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Comments

  • robots.txt for http://www.mobifriends.com/