Parent [none/use name]

  • 1 Post
  • 35 Comments
Joined 4 years ago
cake
Cake day: March 15th, 2021

help-circle





  • Well, addition is built into the instruction set of any CPU, so it only takes one operation. On the other hand, one evaluation of a neural net involves several repeated matrix-vector multiplies followed by the application of a nonlinear “activation function”. Matrix-vector multiply for a square matrix will take 2020=400 multiply operations and about 2019 addition operations for a 20-dimensional input. So we’ll say maybe on the order of 1,000-10,000 times more operations depending on how many layers?
















  • When buying a house people tell you to make sure the roof is in good condition because that’ll be expensive to replace. What they don’t tell you is that is all the other things that you may need to replace and how expensive they are. Fence, paint, siding, water heater, washer/dryer, AC, heater, kitchen appliances, etc. Some this might show up in the inspection report, but it’s hard to get a good idea of what it’ll cost beforehand. Also your realtor will have an incentive to downplay any problems to get the deal done.