Commit Graph

29 Commits

Author SHA1 Message Date
Arturo Filastò
bc1314ca61
Add support for calculating the estimate time remaining (#71) 2019-11-14 12:01:40 +01:00
Arturo Filastò
f425d3f007 Implement the show command (#53) 2019-10-02 18:23:14 +02:00
Simone Basso
b9b555ba68 Integrate further with ooni/probe-engine: episode two (#46)
* utils/geoip.go: use github.com/ooni/probe-engine

Let's start using the engine by rewriting utils/geoip.go to
be just a thin wrapper around the engine functionality.

* Ready for review

* Checkpoint: the im tests are converted

Still have some doubts with respect to the variables that
are passed to MK via probe-engine. Will double check.

* fix(i/c/r/run.go): write the correct logic

* nettests: one more comment and also fix a format string

* Tweak previous

* progress

* Fix doofus

* better comment

* XXX => actionable comment

* Add glue to simplify test keys management

Making the concept of measurement more abstract in the engine is
not feasible because, when submitting a measurement, we need to
modify it to update the report ID and the measurement ID. Therefore,
returning a serialized measurement is not a good idea. We will
keep using a model.Measurement in the engine.

Changing model.Measurement.TestKeys's type from a `interface{}`
pointing to a well defined data structure to `map[string]interface{}`
is a regression because means that we are moving from code that
has a clear and defined structure to code that is more complicated
to parse and validate. Since we're already suffering havily from
the lack of a good schema, I'm not going to make the situation
worst by worsening the engine. At least for ndt7 and psiphon, we
now have a good schema and I don't want to lose that.

However, the current code in this repository is expecting the
test keys to be a `map[string]interface{}`. This choice was
dictated by the fact that we receive a JSON from Measurement Kit
and by the fact that there's not a clear schema.

To solve this tension, in this commit I am going to write glue
adapter code that makes sure that the TestKeys of a Measurement
are converted to `map[string]interface{}`. This will be done
using a type cast where possible and JSON serialization and parsing
otherwise. In a perfect world, glue is not a good idea, but in a
real world it may actually be useful.

When all tests in the engine will have a clear Go data structure,
we'll then remove the glue and just cast to the proper data
structure from `interface{}` where required.

* nettests/performance: use probe-engine

* go.{mod,sum}: upgrade to latest probe-engine

* nettests/middlebox: use ooni/probe-engine

* Update to the latest probe-engine

* web_connectivity: rewrite to use probe-engine

* Cosmetic change suggested by @hellais

* nettests/nettests.go: remove unused code

* nettests/nettests.go: fix progress

* nettests/nettests.go: remove go-measurement-kit code

* We don't depend on go-measurement-kit anymore

* Improve non-verbose output where possible

See also: https://github.com/measurement-kit/measurement-kit/issues/1856

* Make web_connectivity output pleasant

* Update to the latest probe-engine

* nettests/nettests.go: honour sharing settings

* Update to the latest probe-engine

* Use log.WithFields for probe-engine

* Update go.mod go.sum

* Revert "Update go.mod go.sum"

This reverts commit 5ecd38d8236f4a4e9b77ddb8e8a0d1e3cdd4b818.

* Revert "Revert "Update go.mod go.sum""

This reverts commit 6114b31eca98826112032776bd0feff02d763ecd.

* Upgrade ooni/probe-engine

* Unset GOPATH before running go build commands

* Dockefile: fix linux build by using latest

* Update to the latest ooni/probe-engine

```
go get -u github.com/ooni/probe-engine
go mod tidy
```

* Repair build
2019-08-15 18:08:43 +02:00
Arturo Filastò
8402446e47 Use Stdout in CLI logging 2018-09-18 09:55:23 +02:00
Arturo Filastò
e6a67ca5aa Improve output of CLI 2018-09-18 09:36:26 +02:00
Arturo Filastò
6c49bd694f Improve output of incomplete measurements
Rename done to is_done
2018-09-17 13:04:48 +02:00
Arturo Filastò
867204adfb Improve the testKeys logging 2018-09-13 15:59:29 +02:00
Arturo Filastò
4ed94dfc53 Improve the presentation of the measurement listing from the CLI 2018-09-13 14:54:56 +02:00
Arturo Filastò
2b1fb662fb Fix showing data usage indicators 2018-09-12 14:03:07 +02:00
Arturo Filastò
54af7170d4 Add support for data_usage event 2018-09-12 13:42:16 +02:00
Arturo Filastò
2081c25b73 Expose the median_bitrate in the list view 2018-09-11 18:41:15 +02:00
Arturo Filastò
044748c2ce Fix exposing the country code 2018-09-11 18:16:14 +02:00
Arturo Filastò
0ee0c28129 Resolve country code ambigious selection 2018-09-11 18:06:15 +02:00
Arturo Filastò
1637fdbf93 Structured output of measurements 2018-09-10 18:03:32 +02:00
Arturo Filastò
e5c508a94c Fix bug in result listing 2018-09-10 16:56:32 +02:00
Arturo Filastò
b29071f37b Replace summary with test_keys 2018-09-10 12:41:28 +02:00
Arturo Filastò
8fb5e397d7 Cleanup the output of the progress handler 2018-07-16 13:15:01 +02:00
Arturo Filastò
69ec294ad4 Go for a much more minimal progress update 2018-07-14 17:19:06 +02:00
Arturo Filastò
c4c13cb279 Properly compute the padding by fixing the ansi escape regexp 2018-06-29 16:38:13 +02:00
Arturo Filastò
cf588c8466 Move summary related code into it's own package 2018-06-28 13:51:43 +02:00
Arturo Filastò
7951ee6bb5 Add onboard command 2018-06-25 16:31:44 +02:00
Arturo Filastò
65b5feef0d Make the geoip lookup output prettier 2018-06-22 14:25:30 +02:00
Arturo Filastò
5b31403061 Implement progressbar for web_connectivity test 2018-06-22 13:56:42 +02:00
Arturo Filastò
04eb07624c Add zero state 2018-06-22 11:57:25 +02:00
Arturo Filastò
6ff00eeed1 Rename result_item to results 2018-06-22 11:53:30 +02:00
Arturo Filastò
703b260903 Implement missing bits in result listing 2018-06-22 11:53:10 +02:00
Arturo Filastò
ecf3370f53 Implement result listing from CLI
Change the schema to include ASN and Network Name in the results table
2018-05-03 18:40:52 +02:00
Arturo Filastò
e852713ed7 Add functions for structured progress logging 2018-03-22 15:22:29 +01:00
Arturo Filastò
3cdb927eb0 Implement handlers to normalise how logging is handled 2018-02-21 17:06:30 +02:00