flyinggiants.com
robots.txt

Robots Exclusion Standard data for flyinggiants.com

Resource Scan

Scan Details

Site Domain flyinggiants.com
Base Domain flyinggiants.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-04T21:25:17+00:00
Next Scan 2024-06-11T21:25:17+00:00

Last Successful Scan

Scanned2023-09-21T13:43:49+00:00
URL https://flyinggiants.com/robots.txt
Redirect https://www.flyinggiants.com/robots.txt
Redirect Domain www.flyinggiants.com
Redirect Base flyinggiants.com
Domain IPs 104.16.248.51, 104.16.249.51
Redirect IPs 104.17.97.5, 104.17.98.5, 2606:4700::6811:6105, 2606:4700::6811:6205
Response IP 104.17.98.5
Found Yes
Hash e7f8e9be07ceafb5edf1342af1b52e9715de9c3aeef577db6eed1ba10183fda3
SimHash 88959ec6ca42

Groups

*

Rule Path
Disallow /faq.php
Disallow /news/login.aspx
Disallow /giantjargon/
Disallow /content/fgreviews/
Disallow /forums/PostHucker.php
Disallow /gallery/showmembers.php
Disallow /gallery/search.php
Disallow /gallery/comments.php
Disallow /gallery/slideshow.php
Disallow /gallery/showcat.php
Disallow /swapshop/showmembers.php
Disallow /swapshop/search.php
Disallow /swapshop/comments.php
Disallow /swapshop/showcat.php
Disallow /reviews/showmembers.php
Disallow /reviews/search.php
Disallow /reviews/comments.php
Disallow /reviews/showcat.php
Disallow /forums/newreply.php
Disallow /forums/newthread.php
Disallow /forums/editpost.php
Disallow /forums/online.php
Disallow /forums/poll.php
Disallow /forums/printthread.php
Disallow /forums/private.php
Disallow /forums/report.php
Disallow /forums/search.php
Disallow /forums/usercp.php
Disallow /forums/misc.php
Disallow /forums/memberlist.php
Disallow /forums/showpost.php
Disallow /forums/register.php

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /