classting.com
robots.txt

Robots Exclusion Standard data for classting.com

Resource Scan

Scan Details

Site Domain classting.com
Base Domain classting.com
Scan Status Ok
Last Scan2024-06-03T04:28:51+00:00
Next Scan 2024-06-17T04:28:51+00:00

Last Scan

Scanned2024-06-03T04:28:51+00:00
URL https://classting.com/robots.txt
Redirect https://www.classting.com/robots.txt
Redirect Domain www.classting.com
Redirect Base classting.com
Domain IPs 104.22.32.100, 104.22.33.100, 172.67.15.74
Redirect IPs 18.155.68.103, 18.155.68.109, 18.155.68.43, 18.155.68.99, 2600:9000:23d2:1000:7:c63e:6500:93a1, 2600:9000:23d2:2800:7:c63e:6500:93a1, 2600:9000:23d2:3200:7:c63e:6500:93a1, 2600:9000:23d2:3c00:7:c63e:6500:93a1, 2600:9000:23d2:4200:7:c63e:6500:93a1, 2600:9000:23d2:4600:7:c63e:6500:93a1, 2600:9000:23d2:ac00:7:c63e:6500:93a1, 2600:9000:23d2:f200:7:c63e:6500:93a1
Response IP 18.155.68.103
Found Yes
Hash fe65e9aaeaa653034116081cbd46af6f92a55261047e282e287cc77ff01cf063
SimHash 0101d206d472

Groups

baiduspider
rogerbot
embedly
outbrain
pinterest
vkshare
w3c_validator
yeti
naverbot
arc reader
daum

Rule Path
Allow /app/
Allow /styles/
Allow /schools/
Allow /intro
Disallow /outdated_browser.html
Disallow /news
Disallow /join
Disallow /share
Disallow /email_verfication
Disallow /password
Disallow /home
Disallow /apphome
Disallow /notifications
Disallow /auth/
Disallow /sign_up/
Disallow /sign_in/
Disallow /password/
Disallow /users/
Disallow /settings/
Disallow /classes/
Disallow /popular_classes/
Disallow /schools/*/register
Disallow /schools/*/settings
Disallow /schools/*/activation

googlebot
googlebot-news
googlebot-image
googlebot-video
mediapartners-google
adsbot-google
adsbot-google-mobile-apps
apis-google

Rule Path
Allow /app/
Allow /styles/
Allow /schools/
Disallow /outdated_browser.html
Disallow /news
Disallow /join
Disallow /share
Disallow /email_verfication
Disallow /password
Disallow /home
Disallow /apphome
Disallow /notifications
Disallow /auth/
Disallow /sign_up/
Disallow /sign_in/
Disallow /password/
Disallow /users/
Disallow /settings/
Disallow /classes/
Disallow /popular_classes/
Disallow /schools/*/register
Disallow /schools/*/settings
Disallow /schools/*/activation

classting_bot
slackbot
facebookexternalhit
twitterbot
linkedinbot
quora link preview
showyoubot

Rule Path
Allow /app/
Allow /styles/
Allow /users/
Allow /classes/
Allow /schools/
Disallow /outdated_browser.html
Disallow /news
Disallow /join
Disallow /share
Disallow /email_verfication
Disallow /password
Disallow /auth/
Disallow /sign_up/
Disallow /sign_in/
Disallow /password/
Disallow /settings/
Disallow /classes/new
Disallow /classes/requests
Disallow /classes/*/settings
Disallow /classes/*/members
Disallow /classes/*/invitations
Disallow /classes/*/classboxes
Disallow /classes/*/counselings
Disallow /schools/*/register
Disallow /schools/*/settings
Disallow /schools/*/activation

Other Records

Field Value
sitemap /sitemap.xml.gz

Comments

  • robotstxt.org
  • Allow
  • Disallow
  • Allow
  • Disallow
  • Allow
  • Disallow
  • Sitemap
  • DaumWebMasterTool:17874a696532288d2d325ede01abac395bd8ffd47d30649538326f635950e588:ZpxVJwNPuWMQfApYwjcGBg==