malformed_payload on JSON input

[anjanesh]

My JSON : (which I converted from an XLSX at https://tableconvert.com/excel-to-json)

[
    {
        "Investor Name": "Some Venture Partners",
        "Website": "www.example.com",
        "HQ City": "New York City",
        "HQ State/Province": "New York",
        "Investment Types": "Early Stage VC, Later Stage VC, Seed Round",
        "Industries": "Commercial Services, Healthcare, Software",
        "Verticals": "Digital Health, HealthTech, LOHAS & Wellness, TMT",
        "Typical Investment Amount": "",
        "Primary Contact": "Some One",
        "Primary Contact Title": "President & Managing Partner",
        "Primary Contact Email": "[email protected]",
        "Primary Contact Phone": ""
    },
...
]

When I try to upload :

curl \
  -X POST 'http://ip-address/indexes/investors/documents?primaryKey=investors' \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer xxxxxxx' \
  --data-binary @investors.json

I get :

360k{"message":"The `json` payload provided is malformed. `Couldn't serialize document value: expected value at line 1 column 1`.","code":"malformed_payload","type":"invalid_request","link":"https://docs.meilisearch.com/errors#malformed_payload"}

[anjanesh]

Got it working.

[anjanesh]

Does this require an index in the JSON object ? I got it uploaded at both the server and localhost but shows investors as 0

[sanders41]

Check your tasks, is it still processing?

It also looks like you specified investors as the primary key, but your data doesn't have investors.

[anjanesh]

I did

curl \
  -X POST 'http://localhost:7700/indexes/investors/documents?primaryKey=Primary+Contact+Email' \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer aSampleMasterKey' \
  --data-binary @investors.json

But I get :

curl   -X GET 'http://localhost:7700/tasks/0'   -H 'Authorization: Bearer aSampleMasterKey'                                                                                                                       % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   674  100   674    0     0   427k      0 --:--:-- --:--:-- --:--:--  658k{"uid":0,"indexUid":"investors","status":"failed","type":"documentAdditionOrUpdate","canceledBy":null,"details":{"receivedDocuments":1002,"indexedDocuments":0},"error":{"message":"Document identifier `\"[email protected]\"` is invalid. A document identifier can be of type integer or string, only composed of alphanumeric characters (a-z A-Z 0-9), hyphens (-) and underscores (_).","code":"invalid_document_id","type":"invalid_request","link":"https://docs.meilisearch.com/errors#invalid_document_id"},"duration":"PT0.015043100S","enqueuedAt":"2023-12-29T01:45:34.4747375Z","startedAt":"2023-12-29T01:45:34.4766719Z","finishedAt":"2023-12-29T01:45:34.491715Z"}

So I guess I have to have a key column.

[sanders41]

The primary key can only contain certain characters. https://www.meilisearch.com/docs/learn/core_concepts/primary_key#formatting-the-document-id

[anjanesh]

For some reason I keep getting

The `json` payload provided is malformed. `Couldn't serialize document value: expected value at line 1 column 1`

[{"Key":"1","Investor Name":"Venture Partners","Website":"www.venturepartners.com","HQ City":"New York City","HQ State/Province":"New York","Investment ....

when there is nothing wrong with the JSON file which I cross checked online.

[anjanesh]

file contains a UTF-8 BOM - remove it in macOS - sed $'1s/\xef\xbb\xbf//' < investors.json > investors_fixed.json
https://unix.stackexchange.com/a/381263/198431

[curquiza]

Hello @anjanesh
Looks like there is an issue with your primary key. The primary key is one field you will have in ALL your documents and the value of this field should be unique

More about the primary key: https://www.meilisearch.com/docs/learn/core_concepts/primary_key

[anjanesh]

That was also one of the issues - 2 documents had blank primary keys - but was wondering if UTF-8 BOM was also an issue - I had to remove it in macOS.