loop through different websites:confused:

[dflow]

i have an array of website links i want to loop through each and get a certain html id foreach

 

whats wrong with what i did here? :confused:

foreach($links as $page) {
   $phtml = file_get_html($page);

// find all td tags with attribite align=center
foreach($phtml->find('span[id=name]') as $name)
    echo $name->plaintext.'<br><br>';
}

[sloth456]

You haven't enclosed the second foreach statement in curly brackets.

 

It should be:

 

foreach($links as $page) {
   $phtml = file_get_html($page);

// find all td tags with attribite align=center
foreach($phtml->find('span[id=name]') as $name){
    echo $name->plaintext.'<br><br>';
}
}

[dflow]

im getting error:

Parse error: syntax error, unexpected T_FOREACH in parser2.php on line 9

[BlueSkyIS]

there aren't 9 lines in the code snippet. can we see the latest?

[dflow]

<?php
// example of how to use basic selector to retrieve HTML contents
include('simple_html_dom.php');
$links=array("http://www.example.com/page1.htm","
http://www.example.com/page2.htm")



foreach($links as $page) {
   $phtml = file_get_html($page);

// find all td tags with attribite align=center
foreach($phtml->find('span[id=name]') as $name){
    echo $name->plaintext.'<br><br>';
}
}?>

[QuickOldCar]

Was no semicolon after links array

 

<?php
// example of how to use basic selector to retrieve HTML contents
include('simple_html_dom.php');
$links=array("http://www.example.com/page1.htm","
http://www.example.com/page2.htm");



foreach($links as $page) {
   $phtml = file_get_html($page);

// find all td tags with attribite align=center
foreach($phtml->find('span[id=name]') as $name){
    echo $name->plaintext.'<br><br>';
}
}?>

[dflow]

thanks

now i run the whole script and their are 2 problems

1. i get still get non unique links(3 of a kind)

2. error:

Notice: Undefined variable: links in parser.php on line 41

 

Warning: Invalid argument supplied for foreach() in parser.php on line 41

<?php
// example of how to use basic selector to retrieve HTML contents
include('../simple_html_dom.php');

// get DOM from URL or file
$html = file_get_html('http://www.example.com/AllApartments.aspx');



//foreach($html->find('td[class=stableline1]') as $f) {
  // $arrayf[] = $f->innertext;
   
   
//}


// find all link
foreach($html->find('a') as $e) {
     $arraylinks[] = $e->href . '<br>';

}








foreach ($arraylinks as $link) {
   $category = basename(dirname($link));
   $page = basename($link);
   
   if ($category == "apartments") {
   $url="http://www.example.com/apartments/";
      echo  $page.'<br />';
  echo  $url.$page.'<br />';
   }
}

foreach($links['apartments'] as $page) {
   $phtml = file_get_html($url.$page);

// find all td tags with attribite 
foreach($phtml->find('span[id=lblCodiceAppartamento]') as $name){
    echo $name->plaintext.'<br><br>';
}
}?>

[trq]

And which is line 41?

[dflow]

  Quote

And which is line 41?

foreach($links['apartments'] as $page) {

[trq]

The error is pretty self explanatory. $links is not defined anywhere in your code.

[dflow]

  Quote

The error is pretty self explanatory. $links is not defined anywhere in your code.

 

sorry indeed

$links=array();

 

how would i define only unique results for $links ? 

[dflow]

  Quote

thanks

now i run the whole script and their are 2 problems

1. i get still get non unique links(3 of a kind)

2. error:

Notice: Undefined variable: links in parser.php on line 41

 

Warning: Invalid argument supplied for foreach() in parser.php on line 41

<?php
// example of how to use basic selector to retrieve HTML contents
include('../simple_html_dom.php');

// get DOM from URL or file
$html = file_get_html('http://www.example.com/AllApartments.aspx');



//foreach($html->find('td[class=stableline1]') as $f) {
  // $arrayf[] = $f->innertext;
   
   
//}


// find all link
foreach($html->find('a') as $e) {
     $arraylinks[] = $e->href . '<br>';

}








foreach ($arraylinks as $link) {
   $category = basename(dirname($link));
   $page = basename($link);
   
   if ($category == "apartments") {
   $url="http://www.example.com/apartments/";
      echo  $page.'<br />';
  echo  $url.$page.'<br />';
   }
}
$links=array();
foreach($links['apartments'] as $page) {
   $phtml = file_get_html($url.$page);

// find all td tags with attribite 
foreach($phtml->find('span[id=lblCodiceAppartamento]') as $name){
    echo $name->plaintext.'<br><br>';
}
}?>

 

now i get a memory issue although i set the php.ini to maximum

when looping through 20 different urls

Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 700 bytes) in/simplehtmldom/simple_html_dom.php on line 829

[dflow]

i set the maximum memory to 80mb but why is this script taking so much memory??

Fatal error: Allowed memory size of 83886080 bytes exhausted (tried to allocate 700 bytes)

[dflow]

ok fixed

[Pikachu2000]

Try:

VALUES( '$name' )

[Pikachu2000]

Actually, if the data isn't being escaped prior to the query string, you should also do that.