EIDA Test Report

EIDA Availability Report

Created at 27-07-2024 00:32

This document contains results of automated tests of the waveform availability of European EIDA stations and the responsiveness of the EIDA servers to metadata requests.

Description of waveform test program

Availability test of EIDA stations using Python obspy library.

Conducts random waveform requests to single channels of EIDA stations.
One request per minute.
Requested time span randomly selected from last year, span length between 60 and 600 s.
Station randomly selected from the subset of unrestricted European EIDA stations offering at least one out of channels HHZ, BHZ, EHZ or SHZ.
Request full station metadata from selected station and choose channel randomly, restricted to channels HH?, BH?, EH? and SH?.
On successful request apply a restitution to the waveform data.
Evaluate and store result of request in a file database.
Plot and statistically analyze content of file database.

The code does not use the waveform catalog, therefore empty waveform returns are due to data gaps or due to problems in data access and delivery.

Statistics on waveform tests

Statistics on random requests between 26-04-2024 and 27-07-2024 00:32 using station metadata valid since 28-07-2023.

Counters:

unrestricted stations offering channels HHZ,BHZ,EHZ,SHZ: 3427
evaluated stations: 3314
number of requests: 126287

Waveform availability plot

Color coded plot of evaluated EIDA stations. Shows results of 126287 random requests between 26-04-2024 and 27-07-2024. The availability displayed is computed as the relative number of request results with status OK (see table below) compared to the number of all requests to this station.

EIDA waveform response statistics (240727)

Availability of stations: green 100%, yellow 50%, red 0%

Request status statistics of networks:

net OK OK in % NODATA FRAGMENT INCOMPL METAFAIL NOSERV RESTFAIL

1I 1J 2D 2I 3D 4P 4R 7B 7C 7F 8D 8N 9S AB AC AM BE BN BQ BS BW C4 CA CH CL CP CQ CR CZ DK DZ EB EE EI ES FN FO FR GB GE GO GQ GR GU

net	`OK`	`OK in %`	`NODATA`	`FRAGMENT`	`INCOMPL`	`METAFAIL`	`NOSERV`	`RESTFAIL`
1I 1J 2D 2I 3D 4P 4R 7B 7C 7F 8D 8N 9S AB AC AM BE BN BQ BS BW C4 CA CH CL CP CQ CR CZ DK DZ EB EE EI ES FN FO FR GB GE GO GQ GR GU	`129 3 1 0 189 148 0 126 68 128 43 20 39 0 175 0 322 0 515 184 2033 96 746 3572 328 0 477 64 697 505 0 54 135 324 171 74 133 7529 631 2652 0 58 4123 1211`	`86 2 50 0 78 65 0 11 48 93 97 100 45 0 42 0 83 0 96 38 81 75 75 92 60 0 82 51 80 32 0 88 99 92 85 45 98 94 17 69 0 90 86 84`	`21 45 1 1 44 77 4 1002 67 9 0 0 47 141 144 616 63 274 14 285 459 32 87 178 211 94 63 60 165 1028 52 0 0 27 10 89 1 452 2740 1129 278 4 583 204`	`0 0 0 0 7 0 0 3 3 0 1 0 0 0 0 0 0 0 0 3 5 0 8 67 0 0 7 0 2 0 0 0 0 0 1 0 0 6 224 2 0 1 1 11`	`0 0 0 0 1 0 0 0 2 0 0 0 0 0 1 0 0 0 1 0 0 0 0 22 0 0 2 0 0 1 0 0 0 0 1 0 0 5 2 4 0 0 5 1`	`0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0`	`0 54 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 4 0 4 0 146 5 2 0 27 0 1 2 0 7 1 0 18 0 1 13 7 5 0 1 51 6`	`0 0 0 0 0 0 0 0 0 0 0 0 0 0 92 0 0 0 0 2 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0`

Request status statistics of networks (continued):

net OK OK in % NODATA FRAGMENT INCOMPL METAFAIL NOSERV RESTFAIL

GX HA HC HE HF HL HP HS HT HU IP IS IV IX IY JS KO KQ LC LE LX M1 MD ME MK ML MN MT NI NL NO NR NS OE OT OX PL PM QE QM RD RF RN RO

net	`OK`	`OK in %`	`NODATA`	`FRAGMENT`	`INCOMPL`	`METAFAIL`	`NOSERV`	`RESTFAIL`
GX HA HC HE HF HL HP HS HT HU IP IS IV IX IY JS KO KQ LC LE LX M1 MD ME MK ML MN MT NI NL NO NR NS OE OT OX PL PM QE QM RD RF RN RO	`34 1087 497 751 0 1638 796 643 1390 628 0 0 13735 531 171 0 5039 249 0 0 143 278 145 13 30 102 789 240 190 11090 4107 11 1786 944 511 527 292 137 283 102 615 31 364 4407`	`57 94 80 80 0 67 82 96 69 91 0 0 78 76 60 0 76 94 0 0 95 63 97 33 69 97 65 96 80 87 94 1 59 77 75 69 80 56 66 59 97 83 69 85`	`23 36 97 186 50 583 56 13 494 60 86 1734 3336 149 112 209 573 8 41 125 6 161 4 25 13 3 416 8 46 1487 226 858 1212 268 166 225 69 106 137 69 9 5 154 761`	`2 1 1 0 0 87 77 0 17 0 0 0 239 8 1 0 901 0 0 0 0 0 0 0 0 0 1 0 1 85 5 0 2 0 1 4 0 0 0 0 1 1 0 7`	`0 0 2 0 0 8 1 0 9 0 0 0 60 3 0 0 58 0 0 0 0 0 0 0 0 0 2 0 0 5 2 0 0 1 2 3 0 0 3 0 1 0 0 2`	`0 0 0 0 0 0 0 0 0 0 0 0 113 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0`	`0 25 20 0 0 114 34 11 83 0 0 3 21 0 0 0 6 6 0 0 0 1 0 1 0 0 2 0 0 16 9 2 9 2 0 3 0 0 1 0 2 0 6 7`	`0 0 0 0 0 0 0 0 0 0 0 0 41 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0`

Request status statistics of networks (continued):

net OK OK in % NODATA FRAGMENT INCOMPL METAFAIL NOSERV RESTFAIL

SI SK SL SS ST SX TH TQ TT TU TV UD UP UR VI VM WM XE XP Y5 YD ZO

net	`OK`	`OK in %`	`NODATA`	`FRAGMENT`	`INCOMPL`	`METAFAIL`	`NOSERV`	`RESTFAIL`
SI SK SL SS ST SX TH TQ TT TU TV UD UP UR VI VM WM XE XP Y5 YD ZO	`255 242 1139 35 353 746 1363 251 0 2329 43 138 449 343 0 6 100 363 197 798 26 254`	`94 46 92 83 89 91 85 57 0 36 91 50 98 25 0 85 50 97 98 86 27 81`	`13 270 74 7 42 64 208 169 171 3942 4 134 5 1001 42 1 98 9 3 82 69 54`	`0 1 11 0 0 0 4 13 0 35 0 3 0 1 0 0 0 0 0 36 0 1`	`0 0 1 0 0 1 0 5 0 5 0 0 0 0 0 0 0 0 0 8 0 0`	`0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0`	`1 3 2 0 0 1 12 0 0 11 0 1 0 8 0 0 0 1 0 1 0 1`	`0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0`

Status codes used in above statistics:

OK: data delivery and restitution successful
OK in %: Percentage of successful data delivery
NODATA: no data available
FRAGMENT: returned data not contigous
INCOMPL: returned time interval less than requested
METAFAIL: restituted data contain illegal values (Nans)
NOSERV: station metadata request failed
RESTFAIL: removing response failed

Waveform requests, random hit distribution

How many stations have how many hits of random requests.

Request hit statistics showing the distribution of the 126287 requests on the 3314 evaluated stations

Failure rate of inventory requests

This section contains results of inventory test requests on network, station and channel level. A few times per hour all servers get direct metadata requests followed by a metadata request using the routing client of obspy. It is checked whether all servers respond to the direct requests and whether all servers contribute to the routed request. The following results refer to tests carried out since 29-06-2024 00:32:02.

totals: direct requests 2016, routed requests 2016, federator requests 2016

Number of failed requests and failure rates of servers:

server	direct	routed	federator
AFAD	5 ( 0.2%)	2016 (100.0%)	1999 (100.0%)
BGR	9 ( 0.4%)	76 ( 3.8%)	1319 (66.0%)
BGS	7 ( 0.3%)	2016 (100.0%)	1999 (100.0%)
ETH	0 ( 0.0%)	1 ( 0.0%)	0 ( 0.0%)
GFZ	23 ( 1.1%)	23 ( 1.1%)	2 ( 0.1%)
ICGC	197 ( 9.8%)	260 (12.9%)	195 ( 9.8%)
INGV	5 ( 0.2%)	4 ( 0.2%)	2 ( 0.1%)
KOERI	1 ( 0.0%)	1 ( 0.0%)	24 ( 1.2%)
LMU	3 ( 0.1%)	4 ( 0.2%)	2 ( 0.1%)
NIEP	13 ( 0.6%)	5 ( 0.2%)	0 ( 0.0%)
NOA	4 ( 0.2%)	12 ( 0.6%)	6 ( 0.3%)
ODC	7 ( 0.3%)	98 ( 4.9%)	2 ( 0.1%)
RESIF	0 ( 0.0%)	3 ( 0.1%)	7 ( 0.4%)
UIB/NORSAR	1 ( 0.0%)	2 ( 0.1%)	4 ( 0.2%)

failures of routing client: 0

failures of federator: 17

runs without errors: 0 (0.0%)

Responsiveness of all servers plotted with a granularity of 8h; green = 0% errors, orange = 10%, brown = 50%, black = 100%

Remarks

A history of these daily reports (in pdf format)as well as request logs on station level are available at ftp://www.szgrf.bgr.de/pub/EidaAvailability,files history_eida_availability_reports.tgz and stationlogs_eida_availability.tgz, respectively. Reports created after 15-08-2022 are available at https://www.szgrf.bgr.de/eidaqc_report/EidaAvailability

This report was automatically created at 27-07-2024 00:32 MEST usingpandoc 2.18.