classting.com
robots.txt

Robots Exclusion Standard data for classting.com

Resource Scan

Scan Details

Site Domain classting.com
Base Domain classting.com
Scan Status Ok
Last Scan2024-09-23T04:47:54+00:00
Next Scan 2024-10-07T04:47:54+00:00

Last Scan

Scanned2024-09-23T04:47:54+00:00
URL https://classting.com/robots.txt
Redirect https://www.classting.com/robots.txt
Redirect Domain www.classting.com
Redirect Base classting.com
Domain IPs 104.22.32.100, 104.22.33.100, 172.67.15.74
Redirect IPs 2600:9000:2721:1c00:7:c63e:6500:93a1, 2600:9000:2721:5800:7:c63e:6500:93a1, 2600:9000:2721:5c00:7:c63e:6500:93a1, 2600:9000:2721:b600:7:c63e:6500:93a1, 2600:9000:2721:c800:7:c63e:6500:93a1, 2600:9000:2721:e800:7:c63e:6500:93a1, 2600:9000:2721:ea00:7:c63e:6500:93a1, 2600:9000:2721:fc00:7:c63e:6500:93a1, 3.165.102.104, 3.165.102.117, 3.165.102.20, 3.165.102.98
Response IP 3.165.102.20
Found Yes
Hash fe65e9aaeaa653034116081cbd46af6f92a55261047e282e287cc77ff01cf063
SimHash 0101d206d472

Groups

baiduspider
rogerbot
embedly
outbrain
pinterest
vkshare
w3c_validator
yeti
naverbot
arc reader
daum

Rule Path
Allow /app/
Allow /styles/
Allow /schools/
Allow /intro
Disallow /outdated_browser.html
Disallow /news
Disallow /join
Disallow /share
Disallow /email_verfication
Disallow /password
Disallow /home
Disallow /apphome
Disallow /notifications
Disallow /auth/
Disallow /sign_up/
Disallow /sign_in/
Disallow /password/
Disallow /users/
Disallow /settings/
Disallow /classes/
Disallow /popular_classes/
Disallow /schools/*/register
Disallow /schools/*/settings
Disallow /schools/*/activation

googlebot
googlebot-news
googlebot-image
googlebot-video
mediapartners-google
adsbot-google
adsbot-google-mobile-apps
apis-google

Rule Path
Allow /app/
Allow /styles/
Allow /schools/
Disallow /outdated_browser.html
Disallow /news
Disallow /join
Disallow /share
Disallow /email_verfication
Disallow /password
Disallow /home
Disallow /apphome
Disallow /notifications
Disallow /auth/
Disallow /sign_up/
Disallow /sign_in/
Disallow /password/
Disallow /users/
Disallow /settings/
Disallow /classes/
Disallow /popular_classes/
Disallow /schools/*/register
Disallow /schools/*/settings
Disallow /schools/*/activation

classting_bot
slackbot
facebookexternalhit
twitterbot
linkedinbot
quora link preview
showyoubot

Rule Path
Allow /app/
Allow /styles/
Allow /users/
Allow /classes/
Allow /schools/
Disallow /outdated_browser.html
Disallow /news
Disallow /join
Disallow /share
Disallow /email_verfication
Disallow /password
Disallow /auth/
Disallow /sign_up/
Disallow /sign_in/
Disallow /password/
Disallow /settings/
Disallow /classes/new
Disallow /classes/requests
Disallow /classes/*/settings
Disallow /classes/*/members
Disallow /classes/*/invitations
Disallow /classes/*/classboxes
Disallow /classes/*/counselings
Disallow /schools/*/register
Disallow /schools/*/settings
Disallow /schools/*/activation

Other Records

Field Value
sitemap /sitemap.xml.gz

Comments

  • robotstxt.org
  • Allow
  • Disallow
  • Allow
  • Disallow
  • Allow
  • Disallow
  • Sitemap
  • DaumWebMasterTool:17874a696532288d2d325ede01abac395bd8ffd47d30649538326f635950e588:ZpxVJwNPuWMQfApYwjcGBg==