Based on the February App. Mining data and reviewer content, we’re now able to provide an update on the status of Blockstack’s progress as promised in this forum post (App Mining Rewards Is Totally Broken). See notes below about specific numbered issues from the table.
Issue #3: Patrick Stanley mentioned in the January App Mining review that Blockstack has been talking with Product Hunt to get more information than just a number for the Product Hunt (PH) Team Score. The February data contained only a number. The Stealthy PH Team Score dropped from 8.85 in December to 6.25 in January and has remained there. Why? This is confusing. Stealthy underwent considerable UI and performance changes from January to February, which are reflected by Try My UI scoring (-.904 to .493). If the PH Team Score is about the product, why didn’t it reflect this? We believe the PH Team Score should be removed from App Mining until PH provides a detailed explanation about what influences it (note that we have no objection to continuing to use the Product Hunt Community Score in App Mining–though it’s game-ability is a separate issue to consider).
Issue #4: Stealthy’s TryMyUI score increased significantly this review period. However, in the reviewer videos we observed, we saw that testers were not referred to our web page and asked to review a blank page that had nothing to do with Stealthy. One of the testers voiced concerns that Stealthy was malware. Blockstack and Try My UI need to fix and address this problem–though we suspect it only affects mobile applications at present. See pictures of this below:
Issue #7: In the January App Mining meeting, we asked Blockstack if Apps had to be publicly available (i.e. could they be in TestFlight or invite only). Hank answered that internal discussion on the subject said “it probably shouldn’t be some sort of invite only beta”. Then it was expressed that Blockstack would like to move or get away from that. When–it doesn’t seem like something that would be difficult to do in short order? Regardless of what Blockstack does, there really should be publicly available rules around this matter and other App requirements available–especially when Blockstack is giving away $100k a month based on these ideas that are currently tribal knowledge. You can see the full discussion here at time-marker 1:20:50 https://drive.google.com/file/d/1saxZW0rZVyxYr-INjnZqkpwwA7J2NQQR/view
Issue #8: The critic.id issue appears to have been clarified by the Hermes creator on Slack (though oddly the post was deleted). Here is a screenshot of his answer:
There have been some prior discussions on App Mining for February. Here are our thoughts on those:
App mining and trymyui dont seem to provide any real value - We disagree. As we point out above, there are definitely some issues, especially as we’re observing for mobile Apps, but TryMyUI seems to actually add the most value at present. It’s not just perception but people actually using the Apps. We definitely agree with the thoughts of @nicktee in that thread.
https://forum.blockstack.org/t/comments-on-february-app-mining-results/7504 - @friedger makes some excellent points here, especially 2, 3, 7 & 8.
New Github Repo for community to work transparently on App Mining - @patrick interesting, but not a broad way to discuss points in the community. We’ll continue the discussion in the forum where users and the broader community are more frequently contributing.
@jeff, @hank, @patrick, & @muneeb, let me know if you have any questions about the review presented above. Stealthy will be doing this for the March App Mining results as well too. It is nice to see some progress.