mysimstagram.com
robots.txt

Robots Exclusion Standard data for mysimstagram.com

Resource Scan

Scan Details

Site Domain mysimstagram.com
Base Domain mysimstagram.com
Scan Status Ok
Last Scan2024-06-10T16:28:24+00:00
Next Scan 2024-07-10T16:28:24+00:00

Last Scan

Scanned2024-06-10T16:28:24+00:00
URL https://www.mysimstagram.com/robots.txt
Domain IPs 162.159.128.53, 162.159.138.52
Response IP 162.159.138.52
Found Yes
Hash 625f8dcc383df2d73ac6a903b9c0cf3ed1e1c633656f12bae14c310ca0327739
SimHash 205d58936088

Groups

botify
spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /search?
Disallow /list?
Disallow /sign_in?
Disallow /sign_up?
Disallow /*?*filters=*
Disallow /*comments
Disallow /spaces/3284861*
Disallow /spaces/2828436*
Disallow /spaces/2478617*
Disallow /spaces/2814577*
Disallow /spaces/3132069*
Disallow /spaces/2905254*
Disallow /spaces/2957174*
Disallow /spaces/2949297*
Disallow /spaces/2741934*
Disallow /spaces/3069768*
Disallow /spaces/3132041*
Disallow /spaces/3043626*
Disallow /spaces/2477892*
Disallow /spaces/2452885*
Disallow /spaces/2768030*
Disallow /spaces/3275048*
Disallow /spaces/3376510*
Disallow /spaces/3288724*
Disallow /spaces/2516026*
Disallow /spaces/2662395*
Disallow /spaces/2445365*
Disallow /spaces/3340203*
Disallow /spaces/13873141*
Disallow /spaces/6372755*
Disallow /spaces/6341300*
Disallow /spaces/2303831*
Disallow /communities/

Other Records

Field Value
sitemap https://www.mysimstagram.com/sitemap.xml