egg-tcls: fetch_weather.pl annotate

annotate fetch_weather.pl @ 182:24f9f38210fe

Add comments.

author	Matti Hamalainen <ccr@tnsp.org>
date	Tue, 03 Jun 2014 21:37:59 +0300
parents	9b8ec700ede4
children	64e06ee172c7

rev	line source
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	1 #!/usr/bin/perl -w
182 24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	2 ##########################################################################
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	3 #
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	4 # Fetch Weather v0.1 by Matti 'ccr' Hamalainen <ccr@tnsp.org>
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	5 # (C) Copyright 2014 Tecnic Software productions (TNSP)
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	6 #
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	7 # Should be ran as a cronjob, and configured properly.
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	8 # 15 * * * * /absolute/path/to/fetch_weather.pl </path/to/configfile>
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	9 #
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	10 # Configuration file example is in weather.config
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	11 #
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	12 # This script is freely distributable under GNU GPL (version 2) license.
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	13 #
24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	14 ##########################################################################
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	15 use strict;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	16 use LWP::UserAgent;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	17 use HTML::Entities;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	18 use XML::Simple;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	19 use Text::Iconv;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	20 use Date::Parse;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	21 use Data::Dumper;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	22
166 c8d5f3a7c4b7 Add debug option. Matti Hamalainen <ccr@tnsp.org> parents: 164 diff changeset	23
162 4f8a163b2bc1 Work on the backend weather data fetching. Matti Hamalainen <ccr@tnsp.org> parents: 158 diff changeset	24 ###
182 24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	25 ### Configuration settings
162 4f8a163b2bc1 Work on the backend weather data fetching. Matti Hamalainen <ccr@tnsp.org> parents: 158 diff changeset	26 ###
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	27 my %settings = (
166 c8d5f3a7c4b7 Add debug option. Matti Hamalainen <ccr@tnsp.org> parents: 164 diff changeset	28 "debug" => 0,
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	29 "opt_fmi" => 0,
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	30 "opt_tiehallinto" => 0,
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	31 "fmi_api_key" => "",
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	32 "outfile" => "",
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	33 );
162 4f8a163b2bc1 Work on the backend weather data fetching. Matti Hamalainen <ccr@tnsp.org> parents: 158 diff changeset	34
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	35
162 4f8a163b2bc1 Work on the backend weather data fetching. Matti Hamalainen <ccr@tnsp.org> parents: 158 diff changeset	36 ###
4f8a163b2bc1 Work on the backend weather data fetching. Matti Hamalainen <ccr@tnsp.org> parents: 158 diff changeset	37 ### Helper functions
4f8a163b2bc1 Work on the backend weather data fetching. Matti Hamalainen <ccr@tnsp.org> parents: 158 diff changeset	38 ###
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	39 sub mlog($)
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	40 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	41 print STDERR $_[0];
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	42 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	43
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	44
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	45 sub fetch_http($)
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	46 {
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	47 my $tmpAgent = LWP::UserAgent->new;
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	48 $tmpAgent->agent("Mozilla/4.0 (compatible; MSIE 6.0; MSIE 5.5; Windows NT 6.0) Opera 10.63 [en]");
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	49 $tmpAgent->timeout(10);
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	50
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	51 my $tmpRequest = HTTP::Request->new(GET => $_[0]);
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	52
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	53 return $tmpAgent->request($tmpRequest);
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	54 }
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	55
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	56
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	57 sub parse_timestamp($$)
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	58 {
182 24f9f38210fe Add comments. Matti Hamalainen <ccr@tnsp.org> parents: 178 diff changeset	59 # XXX: A bit of a hack, but it works.
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	60 return str2time($_[0]) - str2time("00:00") + $_[1];
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	61 }
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	62
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	63
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	64 sub str_trim($)
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	65 {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	66 my $str = $_[0];
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	67 if (defined($str)) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	68 $str =~ s/^\s*//;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	69 $str =~ s/\s*$//;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	70 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	71 return $str;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	72 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	73
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	74
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	75 ###
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	76 ### Loose HTML parser
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	77 ###
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	78 sub pop_token_a($)
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	79 {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	80 my $tokens = $_[0];
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	81 return shift(@$tokens);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	82 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	83
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	84
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	85 sub pop_token($)
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	86 {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	87 return str_trim(pop_token_a($_[0]));
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	88 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	89
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	90
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	91 sub parse_html_str($)
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	92 {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	93 my $tokens = $_[0];
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	94 my $token = pop_token($tokens);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	95 my $str = "";
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	96 $token =~ s/^\s*//;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	97
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	98 return undef unless (substr($token, 0, 1) eq '"');
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	99 $token = substr($token, 1);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	100
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	101 while (defined($token)) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	102 my $tmp = $token;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	103 $tmp =~ s/\s*$//;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	104 if (substr($tmp, -1) eq '"') {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	105 $str .= substr($tmp, 0, -1);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	106 return $str;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	107 } else {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	108 $str .= $token;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	109 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	110 $token = shift(@$tokens);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	111 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	112 return undef;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	113 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	114
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	115
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	116 sub parse_html_tree($$);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	117
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	118 sub parse_html_tree($$)
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	119 {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	120 my ($tokens, $tree) = @_;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	121
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	122 while (my $token = pop_token($tokens)) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	123 if ($token =~ /^<[!\/]?[a-zA-Z]+/) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	124 $token = lc($token);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	125 if ($token =~ /^<\!.*>$/) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	126 # Ignore comments etc.
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	127 } elsif ($token =~ /^<([a-z]+[1-9])(.)>$/) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	128 my ($name, $args) = ($1, $2);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	129 if ($name eq "meta" \|\| $name eq "img") {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	130 my $tmp = {};
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	131 parse_html_tree($tokens, $tree);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	132 return $tree;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	133 } else {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	134 my $tmp = { "name" => $name, "args" => str_trim($args) };
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	135 parse_html_tree($tokens, $tmp);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	136 push(@{$$tree{"nodes"}}, $tmp);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	137 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	138 } elsif ($token =~ /^<\/([a-z]+[1-9]*)>$/) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	139 return $tree;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	140 } else {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	141 die("HORROR TERROR ELITE: '$token'\n");
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	142 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	143 } else {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	144 $token = str_trim(decode_entities($token));
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	145 push(@{$$tree{"nodes"}}, { "name" => "text", "args" => "", "text" => $token }) if length($token) > 0;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	146 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	147 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	148
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	149 return $tree;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	150 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	151
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	152
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	153 sub parse_html($)
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	154 {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	155 return undef unless defined($_[0]);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	156 my $str = $_[0];
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	157 my $res = { "name" => "", "args" => "" };
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	158 $str =~ tr/\r/ /;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	159 $str =~ tr/\n/ /;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	160 my @tokens = grep { !($_ =~ /^\s$/) } split(/(<\/?[a-zA-Z]+.?>)/, $str);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	161 parse_html_tree(\@tokens, $res);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	162 return $res;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	163 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	164
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	165 sub html_find_node($$$);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	166
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	167 sub html_find_node($$$)
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	168 {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	169 my ($node, $name, $args) = @_;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	170
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	171 if (defined($node)) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	172 if (ref($node) eq "ARRAY") {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	173 foreach my $n (@$node) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	174 my $tmp = html_find_node($n, $name, $args);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	175 # Must do it like this, in order not to break the loop
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	176 return $tmp if defined($tmp);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	177 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	178 } elsif (ref($node) eq "HASH") {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	179 if (defined($$node{"name"})) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	180 if ($$node{"name"} eq $name) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	181 if ($args ne "") {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	182 if (defined($$node{"args"}) && $$node{"args"} =~ /$args/) {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	183 } else {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	184 return html_find_node($$node{"nodes"}, $name, $args);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	185 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	186 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	187 return $node;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	188 } else {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	189 return html_find_node($$node{"nodes"}, $name, $args);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	190 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	191 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	192 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	193 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	194 return undef;
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	195 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	196
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	197
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	198 ###
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	199 ### Helper functions for locating/traversing nodes
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	200 ### in the parsed data tree structure.
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	201 ###
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	202 sub fnode($$)
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	203 {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	204 return html_find_node($_[0], $_[1], "");
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	205 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	206
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	207
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	208 sub fnodea($$$)
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	209 {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	210 return html_find_node($_[0], $_[1], $_[2]);
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	211 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	212
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	213
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	214 sub get_node($$$)
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	215 {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	216 return defined($_[0]->[$_[2]]{"nodes"}[0]{$_[1]}) ? $_[0]->[$_[2]]{"nodes"}[0]{$_[1]} : "";
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	217 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	218
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	219
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	220 ###
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	221 ### Configuration handling
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	222 ###
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	223 sub opt_chk_bool($)
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	224 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	225 if (defined($settings{$_[0]}))
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	226 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	227 my $val = $settings{$_[0]};
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	228 return ($val == 1 \|\| $val eq "true" \|\| $val eq "on" \|\| $val eq "1");
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	229 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	230 else
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	231 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	232 return 0;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	233 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	234 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	235
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	236
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	237 sub opt_chk_valid($$)
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	238 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	239 if (defined($settings{$_[0]}))
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	240 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	241 my $val = $settings{$_[0]};
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	242 return length($val) >= $_[1];
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	243 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	244 else
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	245 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	246 return 0;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	247 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	248 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	249
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	250
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	251 sub opt_get($)
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	252 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	253 if (defined($settings{$_[0]}))
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	254 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	255 return $settings{$_[0]};
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	256 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	257 else
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	258 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	259 return undef;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	260 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	261 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	262
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	263
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	264 sub opt_read_config($)
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	265 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	266 my $filename = $_[0];
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	267 my $errors = 0;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	268 my $line = 0;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	269
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	270 open(CONFFILE, "<", $filename) or die("Could not open configuration '".$filename."'!\n");
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	271 while (<CONFFILE>)
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	272 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	273 $line++;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	274 chomp;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	275 if (/(^\s#\|^\s$)/) {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	276 # Ignore comments and empty lines
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	277 } elsif (/^\s\"?([a-zA-Z0-9_]+)\"?\s=>?\s(\d+),?\s$/) {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	278 my $key = lc($1);
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	279 my $value = $2;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	280 if (defined($settings{$key})) {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	281 $settings{$key} = $value;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	282 } else {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	283 mlog("[$filename:$line] Unknown setting '$key' = $value\n");
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	284 $errors = 1;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	285 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	286 } elsif (/^\s\"?([a-zA-Z0-9_]+)\"?\s=>?\s\"(.?)\",?\s*$/) {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	287 my $key = lc($1);
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	288 my $value = $2;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	289 if (defined($settings{$key})) {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	290 $settings{$key} = $value;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	291 } else {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	292 mlog("[$filename:$line] Unknown setting '$key' = '$value'\n");
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	293 $errors = 1;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	294 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	295 } else {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	296 mlog("[$filename:$line] Syntax error: $_\n");
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	297 $errors = 1;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	298 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	299 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	300 close(CONFFILE);
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	301 return $errors;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	302 }
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	303
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	304
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	305 ###
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	306 ### Main program begins
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	307 ###
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	308 my $weatherdata = {};
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	309
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	310 die(
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	311 "Weather Fetch v0.1 by ccr/TNSP <ccr\@tnsp.org>\n".
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	312 "Usage: $0 <config file>\n"
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	313 ) unless scalar(@ARGV) >= 1;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	314
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	315 my $cfgfile = shift;
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	316 opt_read_config($cfgfile) == 0 or die("Errors while parsing configuration file '".$cfgfile."'.\n");
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	317
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	318
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	319 ###
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	320 ### Fetch tiehallinto road weather measurement data
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	321 ###
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	322 if (opt_chk_bool("opt_tiehallinto"))
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	323 {
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	324 for (my $i = 1; $i <= 22; $i++)
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	325 {
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	326 my $res = fetch_http("http://alk.tiehallinto.fi/alk/tiesaa/tiesaa_maak_".$i.".html");
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	327 if ($res->code >= 200 && $res->code <= 201)
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	328 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	329 my $data = $res->decoded_content;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	330
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	331 # Filter out crap tags we don't want or need
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	332 $data =~ s/\n/§/g;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	333 $data =~ s/<!--.*?-->//ig;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	334 $data =~ s/<map[^>]>.?<\/map>//ig;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	335 $data =~ s/<form[^>]>.?<\/form>//ig;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	336 $data =~ s/<script[^>]>.?<\/script>//ig;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	337 $data =~ s/<meta[^>]*>//ig;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	338 $data =~ s/<font[^>]*>//ig;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	339 $data =~ s/<\/font>//ig;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	340 $data =~ s/<span[^>]*>//ig;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	341 $data =~ s/<\/span>//ig;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	342 $data =~ s/<\/?b>//ig;
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	343
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	344 $data =~ s/<br>//ig;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	345 $data =~ s/ / /ig;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	346 $data =~ s/§/\n/g;
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	347
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	348 # Parse the HTML mess
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	349 my $otree = parse_html($data);
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	350
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	351 # Find our desired element nodes
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	352 my $odata = fnodea(fnode($otree, "body"), "div", "class=elementc");
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	353 my $oupdate = fnode($odata, "p");
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	354 my $time_base = str2time("00:00");
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	355 if ($oupdate) {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	356 my $tmp = $oupdate->{"nodes"}[0]{"text"};
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	357 if ($tmp =~ /:\s+(\d\d\.\d\d\.\d\d\d\d)\s+(\d\d:\d\d)/) {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	358 $time_base = str2time($1);
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	359 }
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	360 }
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	361
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	362 my $oelems = fnode($odata, "table")->{"nodes"};
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	363 for (my $n = 1; $n < scalar(@$oelems); $n++)
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	364 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	365 my $fdata = @$oelems[$n]->{"nodes"};
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	366 $weatherdata->{$fdata->[0]{"nodes"}[0]{"text"}} =
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	367 [
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	368 parse_timestamp(get_node($fdata, "text", 1), $time_base),
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	369 get_node($fdata, "text", 2),
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	370 get_node($fdata, "text", 3),
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	371 get_node($fdata, "text", 4),
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	372 ];
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	373 }
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	374 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	375 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	376 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	377
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	378
9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	379 ###
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	380 ### Fetch FMI data
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	381 ###
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	382 if (opt_chk_bool("opt_fmi"))
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	383 {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	384 die("FMI data scrape enabled, but no API key set.\n") unless opt_chk_valid("fmi_api_key", 10);
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	385
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	386 my $res = fetch_http("http://data.fmi.fi/fmi-apikey/".opt_get("fmi_api_key").
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	387 "/wfs?request=getFeature&storedquery_id=fmi::observations::weather::cities::multipointcoverage".
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	388 "&parameters=temperature,humidity");
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	389
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	390 if ($res->code >= 200 && $res->code <= 201)
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	391 {
170 e4faa3746869 Remove useless parameters from XMLin(). Matti Hamalainen <ccr@tnsp.org> parents: 169 diff changeset	392 my $xml = XMLin($res->decoded_content);
169 c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	393 my $time_base = time();
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	394
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	395 foreach my $item (@{$xml->{"wfs:member"}})
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	396 {
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	397 my $fitem = $item->{"omso:GridSeriesObservation"};
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	398 if (defined($fitem->{"om:phenomenonTime"}{"gml:TimePeriod"}))
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	399 {
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	400 $time_base = str2time($fitem->{"om:phenomenonTime"}{"gml:TimePeriod"}{"gml:endPosition"});
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	401 }
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	402 my $fname = $fitem->{"om:featureOfInterest"}{"sams:SF_SpatialSamplingFeature"}{"sams:shape"}{"gml:MultiPoint"}{"gml:pointMember"}{"gml:Point"}{"gml:name"};
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	403
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	404 my $fres = $fitem->{"om:result"}{"gmlcov:MultiPointCoverage"}{"gml:rangeSet"}{"gml:DataBlock"}{"gml:doubleOrNilReasonTupleList"};
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	405
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	406 ### TODO XXX HALARM - ei ota viimeista arvoa, kuten pitais
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	407 if ($fres =~ /([\+\-]?\d+\.?\d)\s+([\+\-]?\d+\.?\d)/)
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	408 {
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	409 my ($ftemp, $fhumid) = ($1, $2);
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	410 $weatherdata->{$fname} = [
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	411 $time_base,
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	412 $ftemp,
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	413 "",
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	414 "",
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	415 $fhumid,
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	416 ];
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	417 }
c12e422a543a FMI data parsing kinda almost works. It is horrible, though. XML ... :Q Matti Hamalainen <ccr@tnsp.org> parents: 168 diff changeset	418 }
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	419 }
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	420 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	421
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	422
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	423 ###
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	424 ### Output
178 9b8ec700ede4 Clean up the weather data parser backend a bit. Matti Hamalainen <ccr@tnsp.org> parents: 170 diff changeset	425 ###
164 d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	426 if (opt_chk_valid("outfile", 1)) {
d5a0e4248f3e weather: Implement configuration file support for weather fetcher backend. Matti Hamalainen <ccr@tnsp.org> parents: 162 diff changeset	427 open(STDOUT, '>', opt_get("outfile")) or die("Could not open output file '".opt_get("outfile")."'.\n");
158 db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	428 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	429
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	430 binmode STDOUT, ':encoding(utf-8)';
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	431
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	432 foreach my $key (sort { $a cmp $b } keys %$weatherdata)
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	433 {
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	434 print STDOUT $key."\|".join("\|", @{$weatherdata->{$key}})."\n";
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	435 }
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	436
db2b1f74d994 Initial import of weather data fetching backend, written in Perl. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	437 close(STDOUT);

Mercurial > hg > egg-tcls

annotate fetch_weather.pl @ 182:24f9f38210fe