fast.ai   252

« earlier    

fast.ai · Making neural nets uncool again
“This is great news! Here has been my experience using Fast.ai: I had been training a deep learning network using Keras with Tensorflow, for diagnosing medical images - and it took me several months of hard work - tweaking parameters, training, and testing to get acceptable levels of accuracy for our models. And then last month, I switched to Fast.ai (their pre-release version) and I was blown away - my models trained faster, and I matched and finally exceeded accuracy levels achieved with my earlier models. And I accomplished what had taken several months in Keras, in just a few days! And the biggest reasons for it were in my view, fast.ai's learning rate finder, the differential learning rates, and Test Time augmentation - all which are advanced features built into fast.ai. And the other great thing is that fast.ai uses the best defaults automatically, and it trains much, much faster than Keras / TF for some reason.
So I can't wait to try the new release out. I think Fast.ai has set a new bar for deep learning frameworks in terms of speed and ease of use. Thank you for all your great work!”

fast.ai sits on top of PyTorch, making it even easier to use.
fast.ai  pytorch 
18 days ago by Sylphe
Ten Techniques Learned From fast.ai
1. Use the Fast.ai library
2. Don’t use one learning rate, use many
3. How to find the right learning rate
4. Cosine annealing
5. Stochastic Gradient Descent with restarts
6. Anthropomorphise your activation functions
7. Transfer learning is hugely effective in NLP
8. Deep learning can challenge ML in tackling structured data
9. A game-winning bundle: building up sizes, dropout and TTA
10. Creativity is key
dl  ml  deeplearning  fast.ai  transferlearning  learningrate 
11 weeks ago by drmeme
Tensorboard Callback for Fastai - Deep Learning - Deep Learning Course Forums
I created a fast.ai callback that logs model and training information that can be viewed in tensorboard.
Tensorboard is a visualization tool that can help debug and explore your model. Read more about it here. Tensorboa…
tensorboard  fast.ai  fastai  deep-learning 
july 2018 by nharbour

« earlier    

related tags

adam  adamw  ai  algorithm  algorithms  ami  anaconda  arguments  art  attention  augmentation  autoencoder  autograd  automl  averaging  awd-lstm  aws  batch-normalization  batch-size  beam-search  beam  benjamin-franklin  bias  blogs  box  cam  capsule  capsules  career  categorical  class-activation  classification  classifier  cli  cloud  cluster  cnmem  cnn  cnns  code  colab  collaborative-filtering  collaborative  competition  conda  content  convolutional-neural-networks  convolutions  corpus  course-notes  course  courses  cuda  cudnn  cyclical-learning-rate  dae  data-augmentation  data  dataset  dawnbench  decision-trees  deep-learning  deep-sleep  deeplearning  denoising  differential-learning-rates  discussion  dl  download  dropout  education  embedding  ensemble  ethics  farm  fastai  feature-importance  filtering  free  gan  gcloud  generative-adversarial-networks  github  google  gpu  gradient-boosting  health  healthcare  heat-map  heatmap  hinton  hype  hyperparameter-optimization  image-classification  image  imagenet  images  individual-conditional-expectation  install  installation  interpretability  interpretation  jigsaw  job  jupyter-notebook  jupyter  k-nearest-neighbours  kaggle  keras  knn  language-modeling  learning-rate-annealing  learning-rate-finder  learning-rate  learning  learningrate  lecture  libraries  library  lm  long-short-term-memory_networks  lstm  machine-learning  machine_learning  machinelearning  math  metaphor  ml  model  models  movie  movies  multi-modal  naive-bayes  nearest-neighbour  network-architecture  neural-networks  neural-style-transfer  nlp  nmslib  nn  normalization  notebooks  notes  object-detection  occlusion  optimizer  optimizers  overfitting  packages  parameter  partial-dependence  pc  pil  pillow  programming  python  pytorch  qrnn  random-forest  randomforests  rankgauss  reading  recommendation  rectified-linear-unit  recurrent-neural-networks  reinforcement-learning  resnet  resources  rig  rnn  rnns  ruder  sae  sagemaker  script  sdae  search  seq2seq  server  setup  sgd  sgdr  shortcut-connections  single-shot  spam  spell-check  spelling  ssd  state-farm  state  statistics  structure  structured-data  summarisation  summarise  super-convergence  svm  swa  tasks  teaching  technique  techniques  tensorboard  test-time-augmentation  testing  text_classification  theano  time-series-data  tips  training  transfer-learning  transferlearning  tree-interpreter  tuning  tutorial  ubuntu  unit-test  unit-testing  validation  verge  vggcam  videos  visualization  waterfall-charts  weight  wikipedia  windows  winner  winners  word-embedding  word2vec  work  xgboost 

Copy this bookmark:



description:


tags: