DEV Community

Cover image for Why ERP integrations silently fail in production (and how I fixed it in Go)
Steffi
Steffi

Posted on

Why ERP integrations silently fail in production (and how I fixed it in Go)

Most integration systems don’t break immediately. They fail silently over time by corrupting your data.

I learned this the hard way while building ERP integrations between retailers and suppliers. That retailer exchanged data with its suppliers: inventory updates, orders, shipping notices, and invoices. Each message came from different ERP systems with different formats and validation rules.

Now, as I’m preparing for a job interview in the field of ERP integration, I decided to approach this properly.

Integration Flow Design

No matter how different the systems were, every integration system I have ever seen has the similar pattern:

  1. Reception of HTTP Request: The retailer receives an order via HTTPS or SFTP.
  2. Decoding data: The payload is decoded and validated for syntactic correctness.
  3. Validation: The data is validated from a business perspective.
  4. Mapping: The external data is mapped to the internal model.
  5. Response: A response is returned with a status of 201 Created.

The design mistake I made

The biggest mistake I made at the beginning was mixing external formats with internal business logic of the platform. This is the point where most integration systems start to become unmaintainable.

The transport model defines the structure of the incoming payload as defined by the supplier, ERP system, or external API. The external payload can change at any time.

The internal data model belongs to the retailer’s platform, not to the supplier. It should remain as stable as possible. The internal data model is optimized for business logic.

Therefore, I decided to separate this data.

How I fixed it in Go

We declare a struct, which represents the incoming external payload.

type IncomingOrderRequest struct {
 MessageID  string        `json:"message_id"`
 SupplierID string        `json:"supplier_id"`
 Order      IncomingOrder `json:"order"`
} 
Enter fullscreen mode Exit fullscreen mode

The second struct represents the order itself:

type IncomingOrder struct {
 OrderID     string              `json:"order_id"`
 OrderDate   string              `json:"order_date"`
 Currency    string              `json:"currency"`
 TotalAmount float64             `json:"total_amount"`
 Lines       []IncomingOrderLine `json:"lines"`
}
Enter fullscreen mode Exit fullscreen mode

The third struct represents the order lines:

type IncomingOrderLine struct {
 SKU       string  `json:"sku"`
 Qty       int     `json:"qty"`
 UnitPrice float64 `json:"unit_price"`
}
Enter fullscreen mode Exit fullscreen mode

These structs together are related to the external transport model. The next two structs are related to the internal data model:

type InternalOrder struct {
 MessageID   string
 OrderID     string
 SupplierID  string
 OrderDate   string
 Currency    string
 TotalAmount float64
 Lines       []InternalOrderLine
}
type InternalOrderLine struct {
 SKU       string
 Qty       int
 UnitPrice float64
}
Enter fullscreen mode Exit fullscreen mode

The internal model does not depend on Json and on the ERP system.

Step 1: Reject bad requests early

With the following code snippet we make sure that our endpoint only accepts POST methods:

if r.Method != http.MethodPost {
    http.Error(w, "Method not allowed", http.StatusMethodNotAllowed)
    return
}
Enter fullscreen mode Exit fullscreen mode

Any other HTTP methods are rejected. This ensures the system never processes invalid transport data.

Step 2: Decode, but don’t trust the data

You should never trust external input - even if it looks clean:

err := json.NewDecoder(r.Body).Decode(&req)
if err != nil {
    http.Error(w, "Invalid JSON payload", http.StatusBadRequest) // 400
    return
}
Enter fullscreen mode Exit fullscreen mode

Step 3: Validate like your business depends on it

I am validating the data from a business point of view. This is where most production systems fail silently.

 if req.Order.OrderID == "" {
  return errors.New("missing order_id")
 }
 if req.Order.Currency == "" {
  return errors.New("missing currency")
 }
 if req.Order.TotalAmount <= 0 {
  return errors.New("total_amount must be > 0")
 }
 // Lines
 if len(req.Order.Lines) == 0 {
  return errors.New("order must contain at least one line")
 }
Enter fullscreen mode Exit fullscreen mode

If there is an error, it sends an HTTP response (402 Unprocessable entity) to the client.

err = validateRequest(req)
if err != nil {
    http.Error(w, err.Error(), http.StatusUnprocessableEntity)
    return
}
Enter fullscreen mode Exit fullscreen mode

Step 4: Map to something you control

I am translating the external payload to an internal domain model. This is the real architectural boundary that prevents my system from collapsing when external formats change.

func mapToInternal(req IncomingOrderRequest) InternalOrder {
    lines := make([]InternalOrderLine, 0, len(req.Order.Lines))

    for _, l := range req.Order.Lines {
        lines = append(lines, InternalOrderLine{
            SKU: l.SKU,
            Qty: l.Qty,
            UnitPrice: l.UnitPrice,
        })
    }
    return InternalOrder{
       MessageID: req.MessageID,
       OrderID: req.Order.OrderID,
       SupplierID: req.SupplierID,
       OrderDate: req.Order.OrderDate,
       Currency: req.Order.Currency,
       TotalAmount: req.Order.TotalAmount,
       Lines: lines,
       }
    }
Enter fullscreen mode Exit fullscreen mode

Step 5: Send back response

My REST API should return an HTTP response code that the operation has succeeded.

w.Header().Set("Content-Type", "application/json")
w.WriteHeader(http.StatusCreated)
Enter fullscreen mode Exit fullscreen mode

Step 6: Create an order endpoint

We create an API endpoint at /orders, which handles the requests using the orderHandler function.

func main() {
    http.HandleFunc("/orders", orderHandler)
    fmt.Println("Server running on :8080")
    log.Fatal(http.ListenAndServe(":8080", nil))
}
Enter fullscreen mode Exit fullscreen mode

Step 7: Test your service end-to-end

With the REST API up and running, we can now test and see if it works.

go run main.go
Enter fullscreen mode Exit fullscreen mode

In a second Terminal session, we will use the curl request.

curl -X POST http://localhost:8080/orders \
     -H "Content-Type: application/json" \
     -d '{
            "message_id": "msg-1",
            "supplier_id": "supplier-1",
            "order": {
                        "order_id": "ord-1",
                        "order_date": "2026–02–01",
                        "currency": "EUR",
                        "total_amount": 100,
                        "lines": [
                          {
                            "sku": "SKU-1",
                            "qty": 1,
                            "unit_price": 100
                          }
                        ]
                      }
                    }'
Enter fullscreen mode Exit fullscreen mode

What happens if you don’t do this

If you don’t separate transport and domain models, your system won’t fail immediately — it will fail the moment something external changes. Good integration is not about moving data. Integration systems don’t fail because of code. They fail because they don’t control change. Once you separate transport and domain models, your system becomes resilient by design.

  • You can find the implementation of the code discussed in this article on GitHub. Feel free to clone it and extend it for your own integration use cases.

  • Subscribe to my Substack newsletter to get future articles and engineering breakdowns.

  • If you want to go deeper, I created a premium version of this project on Gumroad. Especially useful if you’re a developer who want to build or understand real-world integration services faster or if you are preparing for backend or ERP integration interviews.

Thank you for taking the time to read my articles about building real-world integration services in Go. Happy Coding!

Top comments (0)