f150forum.com
robots.txt

Robots Exclusion Standard data for f150forum.com

Resource Scan

Scan Details

Site Domain f150forum.com
Base Domain f150forum.com
Scan Status Ok
Last Scan2024-11-13T07:35:13+00:00
Next Scan 2024-11-20T07:35:13+00:00

Last Scan

Scanned2024-11-13T07:35:13+00:00
URL https://f150forum.com/robots.txt
Redirect https://www.f150forum.com/robots.txt
Redirect Domain www.f150forum.com
Redirect Base f150forum.com
Domain IPs 104.21.25.18, 172.67.222.3, 2606:4700:3032::6815:1912, 2606:4700:3034::ac43:de03
Redirect IPs 104.21.25.18, 172.67.222.3, 2606:4700:3032::6815:1912, 2606:4700:3034::ac43:de03
Response IP 104.21.25.18
Found Yes
Hash 4b0e12f79ff9895e6c59f590fdf9916b4e5ce9055cbd046f77997c5e84fc68e5
SimHash 635cddc183d1

Groups

gptbot

Rule Path
Disallow /

googleother

Rule Path
Disallow /

*

Rule Path
Disallow /sendmessage.php
Disallow /search.php
Disallow /esp_search.php
Disallow /members/
Disallow /login.php
Disallow /post_thanks.php
Disallow /members/list/
Disallow /tags.php

Other Records

Field Value
sitemap https://www.f150forum.com/sitemap_index.xml.gz