Log In Sign Up

bigfooty.com
robots.txt

Robots Exclusion Standard data for bigfooty.com

Resource Scan

Scan Details

Site Domain bigfooty.com
Base Domain bigfooty.com
Scan Status Ok
Last Scan2024-11-12T04:34:49+00:00
Next Scan 2024-11-19T04:34:49+00:00

Last Scan

Scanned2024-11-12T04:34:49+00:00
URL https://bigfooty.com/robots.txt
Redirect https://www.bigfooty.com/robots.txt
Redirect Domain www.bigfooty.com
Redirect Base bigfooty.com
Domain IPs 35.163.36.130, 54.70.234.43
Redirect IPs 35.163.36.130, 54.70.234.43
Response IP 35.163.36.130
Found Yes
Hash 2432345bae66fb68c2f28374d1d3fd964050380150d03bc391fdf5fc0ab12522
SimHash c108c4200a72

Groups

bytedance

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

msie 6 - ( rogue robot )

Rule Path
Disallow /

fish search

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

teleport

Rule Path
Disallow /

httrack

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webbandit/3.50

Rule Path
Disallow /

semrush

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

rubot

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /forum/account/alert-preferences
Disallow /forum/account/alerts
Disallow /forum/account/avatar
Disallow /forum/account/contact-details
Disallow /forum/account/dismiss-notice
Disallow /forum/account/external-accounts
Disallow /forum/account/following
Disallow /forum/account/ignored
Disallow /forum/account/likes
Disallow /forum/account/news-feed
Disallow /forum/account/personal-details
Disallow /forum/account/preferences
Disallow /forum/account/security
Disallow /forum/account/signature
Disallow /forum/account/two-step
Disallow /forum/admin.php
Disallow /forum/conversations/
Disallow /forum/cron.php
Disallow /forum/posts/*/like
Disallow /forum/posts/*/react?reaction_id=*
Disallow /forum/posts/*/report
Disallow /forum/share/
Disallow /forum/threads/*/reply?quote=*
Disallow /community/account/alert-preferences
Disallow /community/account/alerts
Disallow /community/account/avatar
Disallow /community/account/contact-details
Disallow /community/account/dismiss-notice
Disallow /community/account/external-accounts
Disallow /community/account/following
Disallow /community/account/ignored
Disallow /community/account/likes
Disallow /community/account/news-feed
Disallow /community/account/personal-details
Disallow /community/account/preferences
Disallow /community/account/security
Disallow /community/account/signature
Disallow /community/account/two-step
Disallow /community/admin.php
Disallow /community/conversations/
Disallow /community/cron.php
Disallow /community/posts/*/like
Disallow /community/posts/*/report
Disallow /community/share/
Disallow /community/threads/*/reply?quote=*
Disallow /wp-admin/
Disallow /wp-admin/wp-login.php
Disallow /wp-login.php
Disallow /news/wp-login.php
Disallow /xmlrpc.php
Disallow /news/xmlrpc.php
Back to top

Other Records

Field Value
sitemap https://www.bigfooty.com/forum/sitemap.php
Back to top

Comments

  • Block TikTok - though not respected by this bot.
Back to top