# robots.txt for TheLadders.com # robots.txt,v 3.0 2017/01/04 15:45:00 User-agent: * User-agent: grapeshot Disallow: /job/*/save Disallow: /job/*/apply Disallow: /job/*/login Disallow: /job/*/loginAndSave Disallow: /job/*/loginAndApply Disallow: /member/offer/* Disallow: /lwregister Disallow: /emailOptOut/ Disallow: /optOut/ Disallow: /unsubscribe-guest Disallow: /unsubscribe Disallow: /api/* Sitemap: https://www.theladders.com/job/jobpagesindex.xml.gz Sitemap: https://www.theladders.com/sitemap_index.xml Sitemap: https://www.theladders.com/company/companies.xml.gz Sitemap: https://www.theladders.com/jobs/jobs-sitemap-index.xml Sitemap: https://www.theladders.com/job/expiredjobpagesindex.xml Sitemap: https://www.theladders.com/sitemap/miscellaneous.xml.gz Sitemap: https://www.theladders.com/salary/title-salary.xml.gz Sitemap: https://www.theladders.com/salary/title-salary-location.xml.gz Sitemap: https://www.theladders.com/expert/expert-sitemap.xml.gz