Parece que você quer permitiropen, documentado em sshd (8):
permitopen="host:port"
Limit local ''ssh -L'' port forwarding such that it may only
connect to the specified host and port. IPv6 addresses can be
specified by enclosing the address in square brackets. Multiple
permitopen options may be applied separated by commas. No
pattern matching is performed on the specified hostnames, they
must be literal domains or addresses.