cityfos.com
robots.txt

Robots Exclusion Standard data for cityfos.com

Resource Scan

Scan Details

Site Domain cityfos.com
Base Domain cityfos.com
Scan Status Ok
Last Scan2025-03-08T12:29:06+00:00
Next Scan 2025-03-15T12:29:06+00:00

Last Scan

Scanned2025-03-08T12:29:06+00:00
URL https://cityfos.com/robots.txt
Redirect https://www.cityfos.com/robots.txt
Redirect Domain www.cityfos.com
Redirect Base cityfos.com
Domain IPs 34.194.197.211
Redirect IPs 34.194.197.211
Response IP 34.194.197.211
Found Yes
Hash c2516071575d0df8d812a8c61f25fc0ccad9ef3094eb6b1e37494c07ba74b69c
SimHash 021544070b10

Groups

mediapartners-google

Rule Path
Disallow

bender

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

npbot

Rule Path
Disallow /

msrbot

Rule Path
Disallow /

open*

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

scooter*

Rule Path
Disallow /

websearch*

Rule Path
Disallow /

zyborg*

Rule Path
Disallow /

wget*

Rule Path
Disallow /

turnitinbot*

Rule Path
Disallow /

slysearch*

Rule Path
Disallow /

seekbot*

Rule Path
Disallow /

netresearchserver*

Rule Path
Disallow /

mozdex*

Rule Path
Disallow /

link*

Rule Path
Disallow /

larbin*

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

*

Rule Path
Disallow /myontown
Disallow /*.weblinks.htm
Disallow /websitelinks.htm
Disallow /profile/websitelinks.htm
Disallow /*websitelinks.htm
Disallow /*.map.htm
Disallow /*.vtm.
Disallow /profile/email.htm
Disallow /*/school/*.mi*.
Disallow /*/school/*.sc*.
Disallow /*/school/*.er*.
Disallow /*/school/*.gr*.
Disallow /*.so*.list.htm