cmcc.it
robots.txt

Robots Exclusion Standard data for cmcc.it

Resource Scan

Scan Details

Site Domain cmcc.it
Base Domain cmcc.it
Scan Status Ok
Last Scan2024-05-23T22:00:39+00:00
Next Scan 2024-06-22T22:00:39+00:00

Last Scan

Scanned2024-05-23T22:00:39+00:00
URL https://cmcc.it/robots.txt
Domain IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.20
Found Yes
Hash 093801cb148b019195731a7e56651bb1d57049b422e865ba0876085620dc4710
SimHash fae16cc7ab23

Groups

*

Rule Path
Allow /sitemap.xml
Allow /robots.txt
Allow /future-earth
Allow /oceans
Allow /cities-coasts
Allow /energy
Allow /jobs-growth
Allow /poverty-migrations
Allow /water-food-land-use
Allow /inequalities
Allow /global-policy
Allow /im-a-student
Allow /im-a-scientist
Allow /im-an-alumn
Allow /im-looking-for-solutions
Allow /im-a-teacher
Allow /mediacommunication
Allow /im-curious
Allow /about/mission-and-values
Allow /about/cmcc-foundation-2
Allow /about/governance
Allow /about/strategic-plan-2019-2029
Allow /about/annual-reports
Allow /about/central-administration
Allow /about/fund-raising
Allow /people
Allow /about/offices
Allow /research-organization/strategic-board
Allow /research-organization/research-divisions
Allow /research-organization/research-divisions/advanced-scientific-computing-division
Allow /research-organization/research-divisions/climate-simulations-and-predictions
Allow /research-organization/research-divisions/economic-analysis-of-climate-impacts-and-policy-division
Allow /research-organization/research-divisions/impacts-on-agriculture-forests-and-ecosystem-services
Allow /research-organization/research-divisions/ocean-modeling-and-data-assimilation
Allow /research-organization/research-divisions/ocean-predictions-and-applications
Allow /research-organization/research-divisions/risk-assessment-and-adaptation-strategies
Allow /research-organization/research-divisions/regional-models-and-geo-hydrological-impacts
Allow /research-organization/research-divisions/sustainable-earth-modelling-economics
Allow /research-organization/joint-programs
Allow /publications-type/published-articles
Allow /publications-type/technical-notes
Allow /publications-type/reflections
Allow /publications-type/books
Allow /projects
Allow /lectures-conferences
Allow /education-programs/graduate-programs
Allow /education-programs/master-program
Allow /education-programs/schools
Allow /education-programs/calls-for-application
Allow /models
Allow /data-list
Allow /software-lists
Allow /forecasting-systems
Allow /data-visualization-systems
Allow /cmcc-s-r-l
Allow /super-computing-center-scc
Allow /networking
Allow /we-are-cmcc
Allow /mediacommunication
Allow /mediacommunication/news-updates
Allow /mediacommunication/multimedia-last
Allow /mediacommunication/newsletter
Allow /mediacommunication/communicationmediaoffice
Allow /work-with-us
Allow /tenders
Allow /
Allow /it/*

Other Records

Field Value
crawl-delay 600

megaindex.ru/2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

megaindex.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

Other Records

Field Value
sitemap https://www.cmcc.it/sitemap.xml