thesmackdownhotel.com
robots.txt

Robots Exclusion Standard data for thesmackdownhotel.com

Resource Scan

Scan Details

Site Domain thesmackdownhotel.com
Base Domain thesmackdownhotel.com
Scan Status Ok
Last Scan2024-06-12T23:24:04+00:00
Next Scan 2024-06-19T23:24:04+00:00

Last Scan

Scanned2024-06-12T23:24:04+00:00
URL https://thesmackdownhotel.com/robots.txt
Redirect https://www.thesmackdownhotel.com/robots.txt
Redirect Domain www.thesmackdownhotel.com
Redirect Base thesmackdownhotel.com
Domain IPs 104.21.24.230, 172.67.221.1, 2606:4700:3032::ac43:dd01, 2606:4700:3037::6815:18e6
Redirect IPs 104.21.24.230, 172.67.221.1, 2606:4700:3032::ac43:dd01, 2606:4700:3037::6815:18e6
Response IP 104.21.24.230
Found Yes
Hash 49196d7e0d621eac505a973c86d6083ae38e63a1d3d59cac722ea7f5c2b41232
SimHash 8516426365f5

Groups

*

Rule Path
Allow /*.js*
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /tmp/
Allow *.js*
Allow *.css*
Allow *.png*
Allow *.jpg*
Allow *.gif*
Disallow /user/
Disallow /search?q=
Disallow /index.php?option=com_jlexcomment
Disallow /forum/user/
Disallow /forum/members/
Disallow /forum/statuses/
Disallow /forum/calendar/
Disallow /forum/mp/
Disallow /forum/index.php?act=
Disallow /forum/index.php?app=
Disallow /forum/index.php?s=
Disallow /forum/index.php?show
Disallow /forum/topic/
Disallow /roster/*date%3D*-*-*

*

Rule Path
Allow /sitemap-4seo

Other Records

Field Value
sitemap https://www.thesmackdownhotel.com/sitemap-4seo.xml

Comments

  • User Profiles
  • Internal Search & Comments Requests
  • Old SDH Forum Link Formats, Calendar, Members, etc.
  • Now also disallow all the Topics (so allow just the sections)
  • SDH Roster Pages on Days dates (eg. 2021-06-01)
  • 4SEO-sitemap: sitemap - added on 2023-10-23 14:53:16 - Please do not modify manually.
  • /4SEO-sitemap