Can this be done if so, how? I want to scrape data from xbox.com but the pages I need to scrape only appear after a successful login.
See Question&Answers more detail:osCan this be done if so, how? I want to scrape data from xbox.com but the pages I need to scrape only appear after a successful login.
See Question&Answers more detail:osMost login forms will set a cookie. So you should use a HTTP class like Zend_Http that can store them for further requests. It's presumably as simple as:
$client = new Zend_Http_Client();
$client->setCookieJar(); // this is the crucial part for "logging in"
// make login request
$client->setUri("http://xbox.com/login");
$client->setParameterPost("login", "hackz0r");
$result = $client->request('POST');
// go scraping
...