Can't specify params when running inference on MLServer

[svpino]

When deploying an MLflow model using MLServer, we can't specify params as part of the request.

Here is the error returned by the server:

{"error":"mlflow.utils.proto_json_utils.MlflowInvalidInputException: Invalid input. One of \"instances\" and \"inputs\" must be specified (not both or any other keys).Received: ['inputs', 'params']"}%

Here is how I'm running the server:

mlflow models serve -m runs:/<run_id>/model -p 5000 --enable-mlserver

Here is an example of the request:

curl -X POST http://0.0.0.0:8080/invocations \
    -H "Content-Type: application/json" \
    -d '{"inputs": [{
            "sex": "MALE"
        }], 
        "params": {"capture": true}}'

It seems that MLServer doesn't support parameters as part of the request, which breaks its compatibility with MLflow models that require these parameters to work.

[sakoush]

thanks @svpino there is a PR for a proposed fixed here: #1921