mfitzp.com
robots.txt

Robots Exclusion Standard data for mfitzp.com

Resource Scan

Scan Details

Site Domain mfitzp.com
Base Domain mfitzp.com
Scan Status Ok
Last Scan2024-10-02T19:55:07+00:00
Next Scan 2024-10-09T19:55:07+00:00

Last Scan

Scanned2024-10-02T19:55:07+00:00
URL https://mfitzp.com/robots.txt
Redirect https://blog.martinfitzpatrick.com/robots.txt
Redirect Domain blog.martinfitzpatrick.com
Redirect Base martinfitzpatrick.com
Domain IPs 13.215.144.61, 18.139.194.139, 2406:da18:880:3802::c8, 2406:da18:b3d:e202::64
Redirect IPs 13.228.199.255, 2406:da18:880:3800::c8, 2406:da18:880:3802::c8, 52.74.166.77
Response IP 13.215.144.61
Found Yes
Hash 8df3002425ac27c21a3fd9ae12a09a1bac1897c023c2ed79006b77ee7e79cc0b
SimHash e8ca7991f691

Groups

*

Rule Path
Allow /

mauibot

Rule Path
Disallow /forum/

semrushbot

Rule Path
Disallow /forum/

blexbot

Rule Path
Disallow /forum/

seo spider

Rule Path
Disallow /forum/

*

Rule Path
Disallow /forum/admin/
Disallow /forum/auth/
Disallow /forum/assets/browser-update*.js
Disallow /forum/email/
Disallow /forum/session
Disallow /forum/user-api-key
Disallow /forum/*?api_key*
Disallow /forum/*?*api_key*
Disallow /forum/badges
Disallow /forum/u/
Disallow /forum/my
Disallow /forum/search
Disallow /forum/tag/*/l
Disallow /forum/g
Disallow /forum/t/*/*.rss
Disallow /forum/c/*.rss

googlebot

Rule Path
Disallow /forum/admin/
Disallow /forum/auth/
Disallow /forum/assets/browser-update*.js
Disallow /forum/email/
Disallow /forum/session
Disallow /forum/user-api-key
Disallow /forum/*?api_key*
Disallow /forum/*?*api_key*

Other Records

Field Value
sitemap https://www.mfitzp.com/sitemap.xml
sitemap https://www.mfitzp.com/forum/sitemap.xml
sitemap https://www.mfitzp.com/forum/news.xml