Remove the `disallow` rules from your `robots.txt` file, and make sure every page has `noindex` meta tags on it.

Excluding it from crawling with `robots.txt` is something that seems like a good idea, but if it’s already entered Google’s or Bing’s index, as it seems to be the case, it’ll actually ensure that it’ll never leave their index by blocking their crawlers from discovering that the pages have `noindex` tags.