Commit Graph

461 Commits

Author SHA1 Message Date
Arturo Filastò
1f94b20be5 Add support for parsing the enabled websites category codes
This implements: https://github.com/ooni/probe/issues/1012
2020-02-12 15:07:40 +01:00
Simone Basso
d44102bb7c nettests.go: don't stop when measurement is failed
Closes https://github.com/ooni/probe-engine/issues/316

Rationale: a measurement may fail for a bunch of reasons including
buts in the code. The original determination was that we won't
return an error from the measurement in case of anomaly. But doing
that is error prone, and indeed the Psiphon experiment was not
following this pattern. I claim that this pattern was wrong, and
it's much more in our interest to submit and store on disk anything
that we get from a measurement. This data can be useful to look
into bugs, as well as to discover novel anomalies we didnt' anticipate.
2020-02-11 15:28:35 +01:00
Simone Basso
028ff6ed63
go.mod go.sum: update all dependencies (#107)
Closes https://github.com/ooni/probe/issues/1010
2020-02-11 09:21:56 +01:00
Arturo Filastò
f8a49c972d
Merge pull request #106 from ooni/signal-windows
Explicitly handle SIGINT
2020-02-10 17:38:17 +01:00
Arturo Filastò
9fcfd73234 Add build artifacts to .gitignore 2020-02-10 10:43:13 +01:00
Arturo Filastò
20fb419126 Explicitly handle SIGINT 2020-02-07 15:33:37 +01:00
Arturo Filastò
e9f7c48262 Bump version number 2020-02-05 18:38:23 +01:00
Arturo Filastò
cf21fd1fd8 Improve error handling 2020-02-05 18:28:10 +01:00
Arturo Filastò
b22f224ad3 Fix bug in measurement_file_path collision
We were writing to the same measurement_file_path for a given test
group, because we were using a different filename only in the case of a
many input test, but not in the case of many test_names inside of a
given test group.
2020-02-05 18:26:26 +01:00
Arturo Filastò
2f5486dbd6 Bump tag 2020-01-31 10:49:16 +01:00
Arturo Filastò
95405b8b9f
Merge pull request #103 from ooni/launchd
Add example launchd service for running OONI Probe automatically ever…
2020-01-31 10:48:08 +01:00
Arturo Filastò
a2637be74d
Merge pull request #102 from ooni/independent-file
One measurement, One file
2020-01-31 10:47:49 +01:00
Simone Basso
85e8b611da go.mod go.sum: pin to latest probe-engine with summary for tor
At this stage is fine to just pin to the latest master. I am planning on
blessing periodic releases and it's fine to pin sometimes.

I'm pinning this specific version because it currently supports the
summary for experiment/tor, which @sarathms would benefit from.
2020-01-30 18:12:53 +01:00
Arturo Filastò
2a7579bf25 bash on bash 2020-01-30 11:38:30 +01:00
Arturo Filastò
52332c0977 Changes based on feedback from @bassosimone 2020-01-29 18:48:12 +01:00
Arturo Filastò
4711a76c11 Handle the case when we try to access an old measurement 2020-01-29 10:43:08 +01:00
Arturo Filastò
20084a41b3 Add launchctl command to Readme 2020-01-29 09:45:51 +01:00
Arturo Filastò
1f56f1391f Move launchd script into the Readme 2020-01-29 09:43:39 +01:00
Arturo Filastò
a9392f024a Add example launchd service for running OONI Probe automatically every hour
You should place the file inside of: `$HOME/Library/LaunchAgents` and then enable by running `launchctl load org.ooni.probe.cli.plist`

It assumes you have a `ooniprobe` binary in `~/.ooniprobe/ooniprobe` and a special config file named `/Users/USERNAME/.ooniprobe/config-100sites.json` with a URL limit of 100 sites per run:
```
  "nettests": {
    "websites_url_limit": 100
  },
```
2020-01-28 14:33:38 +01:00
Arturo Filastò
e38d42d33a Update the actions tests 2020-01-28 12:08:09 +01:00
Arturo Filastò
e3d68457b3 Implement writing using the new single measurement pattern 2020-01-28 11:53:00 +01:00
Arturo Filastò
af46a495f4 Update bindata 2020-01-28 11:52:37 +01:00
Arturo Filastò
076be14889 Add database migration script
We need to do a rename and copy because SQLite3 does not support column
addition and constraint changes to existing tables
2020-01-28 11:51:38 +01:00
Arturo Filastò
39214129fa Add bindata command to build script
This used to be present in the Makefile, but then got lost in history
2020-01-28 11:48:25 +01:00
Arturo Filastò
27d98a8660 Small cosmetic fix 2020-01-28 11:05:09 +01:00
Simone Basso
6391e25154 version/version.go: roll out 3.0.0-rc.7 2020-01-28 10:14:45 +01:00
Simone Basso
03e7d2ccac
circumvention: add the tor experiment (#100)
* go.mod go.sum: update all non-probe-engine deps

For each line in the go.mod, run `go get -u -v $package` if the
line is not an indirect dependency and is not probe-engine.

Upgrading probe-engine is going to require the same spell that
is used in probe-engine to update psiphon.

* go get -v github.com/ooni/probe-engine@v0.5.0

This just pins to the latest probe-engine but we've not manually
pinned all the other dependencieds yet.

Take care of the trivial API changes in probe-engine as well, such
that we can have a working build after this commit.

* go.mod go.sum: pin to probe-engine dependencies

Basically: remove all indirect dependencies. Merge this go.mod with
the one of probe-engine, to pin dependencies. Run `go mod tidy`.

* circumvention: add basic implementation of tor

This needs to be polished further, of course. But at least we have
now added support for running tor in the circumvention group.

* Readme.md: document how to update dependencies

* go get -v github.com/ooni/probe-engine@fcc9ee0a7afb

* go get -v github.com/ooni/probe-engine@4d254f5b2

* nettests/tor.go: implement summary test keys
2020-01-28 10:05:54 +01:00
Arturo Filastò
8dff1cc54a Use ~/.ooniprobe as the home directory (#101)
* Use ~/.ooniprobe as the home directory

Remove all probe-legacy related to code since there is no more conflict
between the two
Fixes: ooni/probe#972

* Update .gitignore

Co-authored-by: Simone Basso <bassosimone@gmail.com>
2020-01-27 15:19:32 +01:00
Simone Basso
8d58cb868b version/version.go: bless v3.0.0-rc.6 2020-01-15 15:29:21 +01:00
Arturo Filastò
aeaa393064
Merge pull request #99 from ooni/psiphon-metadata
Improve the output and extraction of psiphon metrics
2020-01-07 16:56:07 +02:00
Arturo Filastò
427ca18985 Refactor pattern of ok !ok 2020-01-07 16:44:11 +02:00
Arturo Filastò
2cb6661340 Fix typo 2020-01-07 16:42:04 +02:00
Arturo Filastò
24316728b9 Improve the output and extraction of psiphon metrics 2020-01-07 16:13:13 +02:00
Simone Basso
1e8b482c23
Allow to specify custom software name and version (#94)
In turn, this allows us to identify as ooniprobe-cli v3.0.0-rc.5.

Closes #41.
2019-12-29 14:07:57 +01:00
Simone Basso
c4a87eaab7
Merge pull request #92 from ooni/develop
Release 3.0.0-rc.5
2019-12-28 18:57:27 +01:00
Simone Basso
628766d07d version/version.go: bump to 3.0.0-rc.5 2019-12-28 18:31:46 +01:00
Simone Basso
955509e6f8 nettests: don't say ETA is infinite
1. only print time left if ETA is positive

2. skip ETA calculation with a single input

3. don't compute ETA for first entry[*]

[*] this is actually what avoids emitting infinite but the other
parts of this diff felt useful yak shaving as well.

Closes #91
2019-12-28 18:28:08 +01:00
Simone Basso
991b875bd9 fix(nettests/telegram.go): remove MK option
This option was meaningful for an MK implementation of Telegram but
is not meaningful for the new Go based implementation.

Closes #90
2019-12-28 17:56:47 +01:00
Simone Basso
259ab41b15 Implement the circumvention nettest group
Only Psiphon for now. Closes #87 #77.
2019-12-28 17:48:07 +01:00
Simone Basso
5e868fe043 Readme.md build.sh: stop spreading lies about GOPATH
Turns out there's no need to unset GOPATH.
2019-12-27 12:22:20 +01:00
Arturo Filastò
7bbbab8774 Handle the SIGINT and SIGTERM signals to support stopping a test cleanly (#84) 2019-12-27 11:32:08 +01:00
Simone Basso
265177a8a6
Merge pull request #88 from ooni/release/3.0.0-rc.4
Release 3.0.0-rc.4
2019-12-27 11:30:32 +01:00
Simone Basso
6cccfeb97a travis: run goveralls inside the docker container
Factor code and reorganize location of go cache and go paths such
that subsequent invocations reuse both dirs.
2019-12-26 19:13:25 +00:00
Simone Basso
1e16f28634 Bump to 3.0.0-rc.4 2019-12-26 18:11:42 +01:00
Simone Basso
67d2f544a7 go.mod go.sum: update all direct dependencies 2019-12-26 18:10:13 +01:00
Simone Basso
8a1622d0c1 Update to ooni/probe-engine@v0.3.0
1. `go get -u github.com/ooni/probe-engine@v0.3.0`

2. `go mod tidy`

3. fix build failures
2019-12-26 18:09:23 +01:00
Arturo Filastò
7d97e3115d
Add minimal user setup for linux 2019-12-09 16:36:17 +01:00
Arturo Filastò
42deb58fac
Merge pull request #82 from ooni/probe-legacy-compat
Add document outlining the differences between probe-cli and probe-le…
2019-12-04 13:14:11 +02:00
Arturo Filastò
868e31bc09
Address feedback from @bassosimone 2019-12-04 13:13:13 +02:00
Arturo Filastò
68d00c8e4f
Merge pull request #83 from ooni/refactor-consolidate
Refactoring to reduce package count
2019-12-04 11:00:15 +02:00