> most teams we talk to can't even tell you how many GPUs are in use right now
how can this be? isn’t this a trivial metric to pull from any clouds monitoring service?
to get the good ones (H100+) you generally have to reserve them, a fixed cost you pay monthly and can’t pretend to not know
No concrete pricing anchors makes this basically useless. Give some estimates for various team sizes even if it’s not exactly what you will charge
> most teams we talk to can't even tell you how many GPUs are in use right now
how can this be? isn’t this a trivial metric to pull from any clouds monitoring service?
to get the good ones (H100+) you generally have to reserve them, a fixed cost you pay monthly and can’t pretend to not know
No concrete pricing anchors makes this basically useless. Give some estimates for various team sizes even if it’s not exactly what you will charge