Hpricot Html Parsing

14/09/2007, 09h34

Hi,
I'm getting funky characters, when parsing html using Hpricot.
How to remove this funky character?

Anyone have a fix / workaround for this?

thanks in advance,
Suja
--
Posted via http://www.ruby-forum.com/.

14/09/2007, 11h53

Hi Suja,

two suggestions:
- check the encoding used by the page you're hashpricoting (doh -
think I just invented a verb, or what).
- puts $KCODE to see if you're running in unicode or not. If you are
hashpricoting a page encoded in UTF-8, but KCODE is set to none (or if
the page is in latin1, but KCODE is set to U), then you'll have to
change the encoding using iconv for instance.

cheers

Thibaut

15/09/2007, 10h17

Suja JS wrote:
> Hi,
> I'm getting funky characters, when parsing html using Hpricot.
> How to remove this funky character?
>
> Anyone have a fix / workaround for this?
>
> thanks in advance,
> Suja

Could you describe these 'funky characters'?
--
Posted via http://www.ruby-forum.com/.

15/09/2007, 10h22

Lee Jarvis wrote:
> Suja JS wrote:
>> Hi,
>> I'm getting funky characters, when parsing html using Hpricot.
>> How to remove this funky character?
>>
>> Anyone have a fix / workaround for this?
>>
>> thanks in advance,
>> Suja
>
> Could you describe these 'funky characters'?

Like 'ï¿½' in this text.
"By Mike Monson CHAMPAIGN ï¿½ Effective today the city of Champaign is
closing three bridges and posting load limits on three others."
--
Posted via http://www.ruby-forum.com/.

15/09/2007, 11h14

> "By Mike Monson CHAMPAIGN ? Effective today the city of Champaign is
> closing three bridges and posting load limits on three others."

hint hint : http://www.news-gazette.com/news/loc...s_limits_loads

The minus character you see after CHAMPAIGN is not a regular "-".

14/09/2007, 09h34	#1 (permalink)
Suja Suchu Messages: n/a Hébergeur:	Hpricot Html Parsing Hi, I'm getting funky characters, when parsing html using Hpricot. How to remove this funky character? Anyone have a fix / workaround for this? thanks in advance, Suja -- Posted via http://www.ruby-forum.com/.

14/09/2007, 11h53	#2 (permalink)
Thibaut Barrère Messages: n/a Hébergeur:	Re: Hpricot Html Parsing Hi Suja, two suggestions: - check the encoding used by the page you're hashpricoting (doh - think I just invented a verb, or what). - puts $KCODE to see if you're running in unicode or not. If you are hashpricoting a page encoded in UTF-8, but KCODE is set to none (or if the page is in latin1, but KCODE is set to U), then you'll have to change the encoding using iconv for instance. cheers Thibaut

15/09/2007, 10h17	#3 (permalink)
Lee Jarvis Messages: n/a Hébergeur:	Re: Hpricot Html Parsing Suja JS wrote: > Hi, > I'm getting funky characters, when parsing html using Hpricot. > How to remove this funky character? > > Anyone have a fix / workaround for this? > > thanks in advance, > Suja Could you describe these 'funky characters'? -- Posted via http://www.ruby-forum.com/.

15/09/2007, 10h22	#4 (permalink)
Suja JS Messages: n/a Hébergeur:	Re: Hpricot Html Parsing Lee Jarvis wrote: > Suja JS wrote: >> Hi, >> I'm getting funky characters, when parsing html using Hpricot. >> How to remove this funky character? >> >> Anyone have a fix / workaround for this? >> >> thanks in advance, >> Suja > > Could you describe these 'funky characters'? Like 'ï¿½' in this text. "By Mike Monson CHAMPAIGN ï¿½ Effective today the city of Champaign is closing three bridges and posting load limits on three others." -- Posted via http://www.ruby-forum.com/.

15/09/2007, 11h14	#5 (permalink)
Thibaut Barrère Messages: n/a Hébergeur:	Re: Hpricot Html Parsing > "By Mike Monson CHAMPAIGN ? Effective today the city of Champaign is > closing three bridges and posting load limits on three others." hint hint : http://www.news-gazette.com/news/loc...s_limits_loads The minus character you see after CHAMPAIGN is not a regular "-".

Outils de la discussion
Afficher une version imprimable Envoyer un lien vers cette page par email