Commit Graph

57 Commits

Author SHA1 Message Date
klzgrad
9a508ee49d Add continuous integration and tests 2020-11-19 00:15:15 +08:00
klzgrad
caebd60a6a Add build scripts 2020-11-19 00:15:15 +08:00
klzgrad
137e054f20 Add example config.json 2020-11-19 00:15:15 +08:00
klzgrad
f059ed8165 Add README 2020-11-19 00:15:15 +08:00
klzgrad
cb0dce3b14 Add LICENSE 2020-11-19 00:15:15 +08:00
klzgrad
8c873f4d83 Add source import tool 2020-11-19 00:15:15 +08:00
klzgrad
d4518fb84c Add .gitignore 2020-11-19 00:15:15 +08:00
klzgrad
51280759de Raise initial padding number to 8
Protect initial handshake lengths.

Common client initial sequence:

- TLS: ClientHello
- TLS: ChangeCipherSpec, Finished
- H2: Magic, SETTINGS, WINDOW_UPDATE
- H2: HEADERS: GET
- H2: SETTINGS ACK

Common server initial sequence:

- TLS: ServerHello, ChangeCipherSpec, ...
- TLS: Certificate, ...
- H2: SETTINGS
- H2: WINDOW_UPDATE
- H2: SETTINGS ACK
- H2: HEADERS: 200 OK
2020-11-19 00:15:14 +08:00
klzgrad
6a76400bc5 Negotiate padding capability automatically
Client: On the first connection does a full Open and detects if the
server supports padding by checking for "Padding" header in the
response. Applies padding if the server does. In the following
connections it's back to Fast Open.

Server: Detects if the client supports padding by checking for "Padding"
header in the CONNECT request. Applies padding if the client does.

Both client and server always send "Padding" headers to somewhat protect
the request and response headers' packet lengths, even if the other side
may not acknowledge padding negotiation, either due to old version or
"Padding" headers being dropped by the frontend.

The manual option --padding is removed.
2020-11-19 00:15:14 +08:00
klzgrad
d0fd922981 Prevents padding headers from being indexed 2020-11-19 00:15:14 +08:00
klzgrad
a9eb227e67 Add option for concurrent transport
Useful only for high-end situations where a single connection
is throttled at 10MB/s somehow.

Makes traffic obfuscation less secure.
2020-11-19 00:15:14 +08:00
klzgrad
2fef54bc66 Add --extra-headers option 2020-11-19 00:15:14 +08:00
klzgrad
88e9359dd5 Add cert net fetcher 2020-11-19 00:15:14 +08:00
klzgrad
9d90c76c4e Redirect DNS for redir://
Run a fake stub DNS resolver at the same port with redir://.
2020-11-19 00:15:14 +08:00
klzgrad
c9daa2ccd4 Support TCP transparent proxying
Enable with naive --listen=redir:// and iptables ... -j REDIRECT
--to-ports 1080.
2020-11-19 00:15:14 +08:00
klzgrad
ab396aaa20 Support loading config.json 2020-11-19 00:15:14 +08:00
klzgrad
9f60b98bda Add QUIC client 2020-11-19 00:15:14 +08:00
klzgrad
41bbc6758f Add http_proxy_socket to BUILD.gn 2020-11-19 00:15:14 +08:00
klzgrad
8470c8fe8f Add server implementation and tunnel padding 2020-11-19 00:15:14 +08:00
klzgrad
d9a58d0828 Add Naive client to BUILD.gn 2020-11-19 00:15:14 +08:00
klzgrad
83edb6075c Add initial implementation of Naive client 2020-11-19 00:15:14 +08:00
klzgrad
a6362fab0a build: Add sysroot creator script 2020-11-19 00:15:14 +08:00
klzgrad
8f79429371 build: Fix glibc symbol pattern 2020-11-19 00:15:14 +08:00
klzgrad
138a75c9fd build: Remove sysroot pipewire workaround 2020-11-19 00:15:14 +08:00
klzgrad
d188df6ea7 build: Pass extra flags to gcc toolchains 2020-11-19 00:15:14 +08:00
CN_SZTL
51cffdce8a build: Add mips64el & i386 OpenWrt toolchain definitions
OpenWrt has arch mips64el and i386, add here to support them.

Signed-off-by: CN_SZTL <cnsztl@project-openwrt.eu.org>
2020-11-19 00:15:14 +08:00
klzgrad
08b9099267 build: Add OpenWrt toolchain definitions 2020-11-19 00:15:14 +08:00
klzgrad
909da4d285 build: Support MIPS -mtune= flag 2020-11-19 00:15:14 +08:00
klzgrad
ed30cdba93 build: Support ARM build without FPU 2020-11-19 00:15:14 +08:00
klzgrad
6ea200c1dc build: Support ARM -mcpu= flag 2020-11-19 00:15:14 +08:00
klzgrad
f08e8be7cd build: Don't use sysroot for host_toolchain
protoc should be built with the host toolchain, usually not needing
the sysroot.
2020-11-19 00:15:14 +08:00
klzgrad
c15d6eebf6 build: Support non-standard ldso in executables 2020-11-19 00:15:14 +08:00
klzgrad
7cbb8e866a allocator: Improve MIPS coverage of spinlocks 2020-11-19 00:15:09 +08:00
klzgrad
06d70db2e2 debug: Fix obsolete max check 2020-11-19 00:10:59 +08:00
klzgrad
86655aa7db debug: Fix uClibc macro condition 2020-11-19 00:10:59 +08:00
klzgrad
ec2689e5c5 process: Remove use of mallinfo under Musl 2020-11-19 00:10:59 +08:00
klzgrad
2e3e2c0576 base: Remove use of mallinfo under Musl 2020-11-19 00:10:59 +08:00
klzgrad
d106c5d96d udp: Fix mmsghdr struct initializer
On OpenWrt x64 there are paddings fields in the struct, making
the initializer list not work.
2020-11-19 00:10:59 +08:00
klzgrad
5f1fd6d3f3 dns: Support Musl 2020-11-19 00:10:59 +08:00
klzgrad
c5815a2be4 libc++: Disable exceptions and RTTI 2020-11-19 00:10:59 +08:00
klzgrad
2050498ce4 quic: Add support for HTTP/3 CONNECT Fast Open
SpdyProxyClientSocket uses read_callback_ for both Connect() and
Read(), and its OnIOComplete() calls read_callback_, thus its fast
connect code checks read_callback_. The code was ported to
QuicProxyClientSocket without much change.

But QuicProxyClientSocket uses a separate connect_callback_ apart from
read_callback_, and its OnIOComplete() calls connect_callback_, thus
when headers are received after Connect() it doesn't need to check
read_callback_ and should always avoid calling connect_callback_.
2020-11-19 00:10:59 +08:00
klzgrad
60f5d4318c h2: Pad RST_STREAM frames
Clients sending too many RST_STREAM is an irregular behavior.

Hack in a preceding END_STREAM DATA frame padded towards [48, 72]
before RST_STREAM so that the TLS record looks like a HEADERS frame.

The server often replies to this with a WINDOW_UPDATE because padding
is accounted in flow control. Whether this constitudes a new irregular
behavior is still unclear.
2020-11-19 00:10:59 +08:00
klzgrad
59b29cb34e h2: Add support for HTTP/2 CONNECT Fast Open
SpdyProxyClientSocket waits for 200 OK before returning OK for Connect.

Change that behavior to returning OK immediately after CONNECT header.

This feature is enabled by default. It should probably be turned on
through an interface but that implies passing a flag through deep
interface chains right now requiring intrusive changes to multiple
places.

Design notes:

The current approach is better than the obvious TCP Fast Open style fake
Connect().

Fast Open should not be used for preconnects as preconnects need actual
connections set up. The Naive client does not use preconnects per se
(using "...RawConnect") but the user agent will use preconnects and the
Naive client has to infer that. Hence there is a need to check the
incoming socket for available bytes right before Connect() and configure
whether a socket should be connected with Fast Open. But fake Connect()
make it difficult to check the incoming socket because it immediately
returns and there is not enough time for the first read of the incoming
socket to arrive.

To check for preconnects it is best to push the first read of the
incoming socket to as late as possible. The other (wrong) way of doing
that is to pass in an early read callback and call it immediately after
sending HEADERS and then send the available bytes right there. This way
is wrong because it does not work with late binding, which assumes
Connect() is idempotent and causes sockets opened in this way to be
potentially bound to the wrong socket requests.

The current approach is to return OK in Connect() right after sending
HEADERS before getting the reply, which is to be received later. If the
reply is received during a subsequent Read() and the reply indicates an
error, the error is returned to the callback of the Read(); otherwise
the error is ignored with the connection disconnected and subsequent
Read() and Write() should discover the disconnection.
2020-11-19 00:10:59 +08:00
klzgrad
8ec6cef37b h2: Notify delegate about read EOF
So the delegate can close the socket instead of keeping sending data.

Read EOF or h2 half-closed (remote) state was introduced in
https://codereview.chromium.org/129543002. But StreamSocket doesnt
really supports a half closed state, so upon a read EOF the only sane
action is to close the socket immediately even if in theory more send
is possible.
2020-11-19 00:10:59 +08:00
klzgrad
5407fbd651 h2: Reduce warnings about RST on invalid streams
Per RFC 7540#6.4:

  However, after sending the RST_STREAM, the sending endpoint MUST be
  prepared to receive and process additional frames sent on the stream
  that might have been sent by the peer prior to the arrival of the
  RST_STREAM.
2020-11-19 00:10:59 +08:00
klzgrad
b419f7fe83 socket: Support NetworkIsolationKey in RawConnect 2020-11-19 00:10:59 +08:00
klzgrad
1d9a0f09a7 socket: Fix a bug in TCPClientSocket
Needed by transparent proxying.
2020-11-19 00:10:59 +08:00
klzgrad
f6cd4d291e socket: Force tunneling for all sockets
After the upstream large refactor, now only WebSocket sockets
have tunneling via HTTP/1 proxies. "Raw" sockets in the normal
socket pool don't have tunneling via HTTP/1 proxies, i.e.
CONNECT headers are not sent, instead the raw payload is sent
as-is to the HTTP/1 proxy, which makes it not work.

For the reference the official code does this:

- HTTP sockets via HTTP/1 proxies: normal pool, no tunneling.
- HTTPS sockets via HTTP/1 proxies: normal pool, no tunneling
  but does its own proxy encapsulation.
- WS sockets via HTTP/1 proxies: WS pool, tunneling.

We want the normal pool because the WS pool has some extra
restrictions but we also want tunneling to expose a client socket
with the proxy built in.

Therefore we can force tunneling for all sockets. This will always
send CONNECT headers first and thus break HTTP client sockets via
HTTP/1 proxies, but since we don't use this combination this is ok.
2020-11-19 00:10:59 +08:00
klzgrad
2351ac16e2 socket: Add RawConnect method 2020-11-19 00:10:59 +08:00
klzgrad
0c4de45ed5 socket: Allow higher limits for proxies
As an intermediary proxy we should not enforce stricter connection
limits in addition to what the user is already enforcing.
2020-11-19 00:10:59 +08:00