Commit Graph

61 Commits

Author SHA1 Message Date
klzgrad
cc94a888c8 Add example config.json 2022-08-06 19:25:48 +08:00
klzgrad
6848fc48a2 Add README 2022-08-06 19:25:48 +08:00
klzgrad
726c5bda4f Add LICENSE 2022-08-06 19:25:48 +08:00
klzgrad
e8298ea52e Add source import tool 2022-08-06 19:25:48 +08:00
klzgrad
6d57992bb9 Add Cronet CGO SDK builder
bidi_example.cc does not work in cross compile yet, because libstdc++-dev
is not installed in cross compile sysroots.
2022-08-06 19:25:48 +08:00
klzgrad
03462b498d Add initial implementation of Naive client 2022-08-06 19:25:48 +08:00
klzgrad
d4ac4bed59 cronet: Support setting socket limits from experimental option
Example:

Pool type: NORMAL_SOCKET_POOL or WEBSOCKET_SOCKET_POOL.

  "socket_limits": {
    "max_sockets_per_pool": { "NORMAL_SOCKET_POOL": 1024 },
    "max_sockets_per_proxy_server": {"NORMAL_SOCKET_POOL": 1024 },
    "max_sockets_per_group": { "NORMAL_SOCKET_POOL": 1024 }
  },
2022-08-06 19:25:48 +08:00
klzgrad
a0bd19efe1 cronet: Add cert net fetcher 2022-08-06 19:25:48 +08:00
klzgrad
1f98137564 net, grpc_support: Set NetworkIsolationKey from header
If BidirectionalStream request contains a -network-isolation-key
header, it is used to set the network isolation key of the stream.
The header itself is removed and not transmitted.

The header value should be a valid URL with different host and port
for each different network isolation key. Invalid header value is
reported by returning error from bidirectional_stream_start.

Network isolation takes effect only if it is enabled by experimental
option of

  "feature_list": {
    "enable-features": "PartitionConnectionsByNetworkIsolationKey"
  }
2022-08-06 19:25:48 +08:00
klzgrad
495771d38b cronet: Support setting feature list from experimental option 2022-08-06 19:25:48 +08:00
klzgrad
49e1369d7c cronet: Use fixed proxy resolution from experimental option proxy_server 2022-08-06 19:25:47 +08:00
klzgrad
766e0bd244 cronet: Do not hide symbols on Android shared build
The default compiler config hides all but JNI symbols, but here
it is building the shared library of Cronet C API.
2022-08-06 19:25:47 +08:00
klzgrad
f32e08b4e9 prefs: Disable Android JNI 2022-08-06 19:25:47 +08:00
klzgrad
834246c640 net: Allow overriding CONNECT authority with header
The -connect-authority header overrides the CONNECT authority field.

The Cronet bidirectional_stream API does not have a way to pass in this
field to support tunnels, so it has to be smuggled in via a header.
2022-08-06 19:25:47 +08:00
klzgrad
3bd79168a1 grpc_support: Fix CFI icall breakage
When the Cronet function pointers are passed into shared library,
they cannot be checked with CFI.
2022-08-06 19:25:47 +08:00
klzgrad
b76edb6ba1 build: Use thinlto max optimization for everything 2022-08-06 19:25:47 +08:00
klzgrad
d4cabb3bf9 base: Fix Android build missing -latomic 2022-08-06 19:25:47 +08:00
klzgrad
bd6138a768 base: Fix OpenWrt build with use_allocator_shim=false 2022-08-06 19:25:47 +08:00
klzgrad
5188b8ce25 allocator: Improve MIPS coverage of spinlocks 2022-08-06 19:25:47 +08:00
klzgrad
d97c84c161 debug: Fix uClibc macro condition 2022-08-06 19:25:47 +08:00
klzgrad
a5efa3f50a third_party: Fix missing sgidefs.h for Musl 2022-08-06 19:25:47 +08:00
klzgrad
583da02a37 base: Do not forward declare stat64 for Musl 2022-08-06 19:25:47 +08:00
klzgrad
f80f276a94 base: Fix narrowing casting for Musl 2022-08-06 19:25:47 +08:00
klzgrad
1de17bcbe7 base: Disable __close overloading for Musl 2022-08-06 19:25:47 +08:00
klzgrad
5db17f7975 process: Remove use of mallinfo for Musl 2022-08-06 19:25:47 +08:00
klzgrad
b03c7af254 base: Remove use of mallinfo for Musl 2022-08-06 19:25:47 +08:00
klzgrad
5878e33415 udp: Fix mmsghdr struct initializer for Musl
On OpenWrt x64 there are paddings fields in the struct, making
the initializer list not work.
2022-08-06 19:25:47 +08:00
klzgrad
2541c08742 dns: Support Musl 2022-08-06 19:25:47 +08:00
klzgrad
2d25a9287b dns: Fix iwyu 2022-08-06 19:25:47 +08:00
klzgrad
582bc2bcb0 debug: Fix obsolete max check 2022-08-06 19:25:47 +08:00
klzgrad
db9c4a9885 build: Add sysroot creator script 2022-08-06 19:25:47 +08:00
klzgrad
253fae59f7 build: Add OpenWrt toolchains 2022-08-06 19:25:47 +08:00
klzgrad
e32a3a4c3b build: Support MIPS -mtune= flag 2022-08-06 19:25:47 +08:00
klzgrad
5ffe2d0e21 build: Support ARM build without FPU 2022-08-06 19:25:47 +08:00
klzgrad
9428cf118f build: Support -mcpu= on ARM and ARM64 2022-08-06 19:25:46 +08:00
klzgrad
7d0f4c500f quic: Add support for HTTP/3 CONNECT Fast Open
SpdyProxyClientSocket uses read_callback_ for both Connect() and
Read(), and its OnIOComplete() calls read_callback_, thus its fast
connect code checks read_callback_. The code was ported to
QuicProxyClientSocket without much change.

But QuicProxyClientSocket uses a separate connect_callback_ apart from
read_callback_, and its OnIOComplete() calls connect_callback_, thus
when headers are received after Connect() it doesn't need to check
read_callback_ and should always avoid calling connect_callback_.
2022-08-06 13:21:39 +08:00
klzgrad
b013e35fdf h2: Pad RST_STREAM frames
Clients sending too many RST_STREAM is an irregular behavior.

Hack in a preceding END_STREAM DATA frame padded towards [48, 72]
before RST_STREAM so that the TLS record looks like a HEADERS frame.

The server often replies to this with a WINDOW_UPDATE because padding
is accounted in flow control. Whether this constitudes a new irregular
behavior is still unclear.
2022-08-06 13:21:39 +08:00
klzgrad
ebcacd42fe h2: Add support for HTTP/2 CONNECT Fast Open
SpdyProxyClientSocket waits for 200 OK before returning OK for Connect.

Change that behavior to returning OK immediately after CONNECT header.

This feature is enabled by a "fastopen" header via the proxy delegate.

Design notes:

The current approach is better than the obvious TCP Fast Open style fake
Connect().

Fast Open should not be used for preconnects as preconnects need actual
connections set up. The Naive client does not use preconnects per se
(using "...RawConnect") but the user agent will use preconnects and the
Naive client has to infer that. Hence there is a need to check the
incoming socket for available bytes right before Connect() and configure
whether a socket should be connected with Fast Open. But fake Connect()
make it difficult to check the incoming socket because it immediately
returns and there is not enough time for the first read of the incoming
socket to arrive.

To check for preconnects it is best to push the first read of the
incoming socket to as late as possible. The other (wrong) way of doing
that is to pass in an early read callback and call it immediately after
sending HEADERS and then send the available bytes right there. This way
is wrong because it does not work with late binding, which assumes
Connect() is idempotent and causes sockets opened in this way to be
potentially bound to the wrong socket requests.

The current approach is to return OK in Connect() right after sending
HEADERS before getting the reply, which is to be received later. If the
reply is received during a subsequent Read() and the reply indicates an
error, the error is returned to the callback of the Read(); otherwise
the error is ignored with the connection disconnected and subsequent
Read() and Write() should discover the disconnection.
2022-08-06 13:21:39 +08:00
klzgrad
6316f27ff4 h2: Reduce warnings about RST on invalid streams
Per RFC 7540#6.4:

  However, after sending the RST_STREAM, the sending endpoint MUST be
  prepared to receive and process additional frames sent on the stream
  that might have been sent by the peer prior to the arrival of the
  RST_STREAM.
2022-08-06 13:21:39 +08:00
klzgrad
2f3c559863 socket: Force tunneling for all sockets
In the socket system, only WebSocket sockets are allowed to tunnel
through HTTP/1 proxies. "Raw" sockets in the normal socket pool don't
have it, and their CONNECT headers are not sent, instead the raw
payload is sent as-is to the HTTP/1 proxy, breaking the proxying.

The socket system works like this:

- HTTP sockets via HTTP/1 proxies: normal pool, no tunneling.
- HTTPS sockets via HTTP/1 proxies: normal pool, no tunneling,
  but does its own proxy encapsulation.
- WS sockets via HTTP/1 proxies: WS pool, tunneling.

In Naive, we need the normal pool because the WS pool has some extra
restrictions but we also need tunneling to produce a client socket
with proxy tunneling built in.

Therefore force tunneling for all sockets and have them always send
CONNECT headers. This will otherwise break regular HTTP client sockets
via HTTP/1 proxies, but as we don't use this combination, it is ok.
2022-08-06 13:21:39 +08:00
klzgrad
3a6ab67727 socket: Allow higher limits for proxies
As an intermediary proxy we should not enforce stricter connection
limits in addition to what the user is already enforcing.
2022-08-06 13:21:39 +08:00
klzgrad
244f5fac39 socket: Add RawConnect method 2022-08-06 13:21:38 +08:00
klzgrad
670a9bcac4 cert: Handle AIA response in PKCS#7 format 2022-08-06 12:00:03 +08:00
klzgrad
2177ebd02d cert: Use builtin verifier on Android and Linux 2022-08-06 12:00:03 +08:00
klzgrad
ac88965255 cert: Add SystemTrustStoreStaticUnix
It reads CA certificates from:

* The file in environment variable SSL_CERT_FILE
* The first available file of

/etc/ssl/certs/ca-certificates.crt (Debian/Ubuntu/Gentoo etc.)
/etc/pki/tls/certs/ca-bundle.crt (Fedora/RHEL 6)
/etc/ssl/ca-bundle.pem (OpenSUSE)
/etc/pki/tls/cacert.pem (OpenELEC)
/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem (CentOS/RHEL 7)
/etc/ssl/cert.pem (Alpine Linux)

* Files in the directory of environment variable SSL_CERT_DIR
* Files in the first available directory of

/etc/ssl/certs (SLES10/SLES11, https://golang.org/issue/12139)
/etc/pki/tls/certs (Fedora/RHEL)
/system/etc/security/cacerts (Android)
2022-08-06 12:00:03 +08:00
klzgrad
1f5d1c68f1 libc++: Disable exceptions and RTTI
Except on Mac, where exceptions are required.
And except on Android, where rtti is required.
2022-08-06 11:58:05 +08:00
klzgrad
f43656252f url: Remove perfetto tracing 2022-08-06 11:58:05 +08:00
klzgrad
7ce3f4d36f base: Disable trace event
This allows builds with enable_base_tracing=false.
2022-08-06 11:58:05 +08:00
klzgrad
fc541b2af8 lss: Avoid naming conflict in fstatat64
Supports OpenWrt builds.
2022-08-06 11:58:05 +08:00
klzgrad
e1bd564018 base: Fix iwyu in file_path.cc 2022-08-06 11:58:05 +08:00