Domain valuation agent is improving, but still has issues.
Dharmesh Shah, the HubSpot co-founder and AI enthusiast who sold Chat.com to OpenAI, has been rolling out frequent updates to his domain valuation agent lately.
I tested the system yesterday and again today after he pushed another round of improvements.
Compared to when I first tried it a month ago, the tool appears to hallucinate less. I say “appears” because it’s now showing fewer comparable sales for each domain, which makes it harder to assess its reasoning and check its accuracy.
With domain appraisals, users want to see how the value is calculated. The agent currently provides limited data, especially when it comes to comps, which makes it difficult to understand how it arrives at specific valuations.
According to the tool, historical sales data is now being pulled from NameBio. That’s a positive step, as it should reduce the risk of hallucinated numbers. Still, there are signs that it may be using other sources or fabricating information. For example, it incorrectly claims that my domain CandyCorn.com sold for $150,000 on NameJet in 2021.
Some of the current marketplace listings it shows are also inaccurate. Shortbread.com, for instance, is listed at both $100,000 and $65,000. One of those listings lacks a source, so it might be an unauthorized posting or an error. In any case, the tool does not factor marketplace listings into its valuations, so they don’t influence the final price.
One common issue with AI-driven appraisals is inconsistency. A tool might give different values for the same domain on separate runs. In that regard, Dharmesh’s agent is doing well. It appears to deliver consistent valuations for the same domain each time you appraise it.
Source: https://domainnamewire.com/
