introducing   138

« earlier    

Introducing the Snapdragon 8cx, Qualcomm’s First PC Processor
As the competition in the PC processor market intensifies between Intel and AMD, Qualcomm has unveiled the Snapdragon 8cx, its first PC processor. Aimed mostly at ultraportable laptop market, Qualcomm claims that the 8cx is the first 7nm chip in a PC platform, though AMD is not far behind with the imminent release of its...

The post Introducing the Snapdragon 8cx, Qualcomm’s First PC Processor appeared first on .
Introducing  the  Snapdragon  8cx  Qualcomm’s  First  PC  Processor 
december 2018 by vrzone
Introducing a 4 part series on Security Tokens by Sheldon Freedman from Hassans. – Daily Fintech
Editors note. This post is written by Sheldon Freedman, a fintech and funds lawyer at Hassans in Gibraltar.  Security Tokens is a big, complex subject that requires legal, technical and commercial  knowledge.
introducing  a  4  part  seri 
october 2018 by marshallk
Tiny Endian
How to scrape the web and not get caught
This article will be just a quick one. It's a few line of code recipe on how to mitigate IP restrictions and WAFs when crawling the web. If you're reading this you probably already already tried web scraping. It's all easy breezy until one day someone managing the website you're harvesting data from realizes what happens and blocks your IP. If you're running your scrappers in an automated way you'll start seeing them failing miserably. You'll probably want to solve this problem fast, before any of precious data slips through your fingers.
Sa hello to proxies
While it might be tempting to use one of paid providers of such services it isn't that hard to craft a home baked solution that will cost you no money. This is thanks to an awesome project scrapy-rotating-proxies.
Just add it to your project like it is described in the documentation:
# settings.py
# ...
ROTATING_PROXY_LIST = [
'proxy1.com:8000',
'proxy2.com:8031',
# ...
]
ROTATING_PROXY_LIST_PATH = 'proxies.txt'
# ...
So, where to get this proxies.txt list from? This is easier than you think. I was not able to find a python project that would provide a list free proxies out of the box, but there is a list-proxies node module made exactly for that!
Installation is extremely simple, as well as usage:
proxy-lists getProxies --sources-white-list="gatherproxy,sockslist"
This will save a bulky list of proxies in your proxies.txt file.
Say hello to Makefiles
Now you're essentially running a mixed-language project (with Python for scrapy and JS for list-proxies). You need a way to synchronize these two tools. What would be better than the lingua franca of builds and orchestration - the Makefile.
Just create a target:
all:
yarn run proxy-lists getProxies --sources-white-list=$$PROXIES_SOURCE_LIST
scrapy crawl mycrawler -o myoutput.csv
rm -r proxies.txt
And after you're done with that, your build step in Jenkins becomes just:
make all
Things to consider
Of  course  there's  an  overhead  to  pay  for  using  this  -  after  introducing  proxies  my  crawl  times  grew  by  an  order  magnitude  from  minutes  to  hours!  But  hey_  it  works  and  it's  free_  so  if  you're  not  willing  to  pay  for  data  in  cash_  you  need  to  pay  for  it  with  time.  Luckily  for  you  with  this  sweet  hack  it's  build  server's  time_  not  yours.  from iphone
april 2018 by hendry

« earlier    

related tags

#piday  #raspberrypi  &  /code/project  'trans  (music)  (successfully)  (to  (white  *  -  01  02:02pm  04:00am  05:00am  05:18am  05:27pm  06:02pm  06:55am  07  07:00am  07:00pm  08  08:09am  08:25pm  09:30am  09:55pm  100%  10:00am  11  11:00am  11:20am  11:30am  12  123d  1284p  12:00pm  12:10pm  12:18pm  12:42pm  13  14  15  17  18  19  2  2012  2013  2015  2017-02-09  2017-02-10  2017-02-11  2017-02-12  2017-02-13  2017-02-19  2017-02-20  2017-02-21  2017-02-22  2017-02-23  2017-02-24  2017-04-06  2017-04-07  2017-04-08  2017-04-09  2017-04-14  2017-04-15  2017-04-16  2017-06-14  2017-06-16  2017-09-19  2017-09-21  2017-09-23  2018  22  23  27  29  3d  4  5.5:  5  500px  7  8cx  @raspberry_pi  a  accurate  actress'  adafruit  ads  after  agile  ai  alliioop:  along  an  and  android  another  api  apis  apple  appsperiments:  april  arduino  artist  artists  as  assessment  at  august  awesome  band  base)  bbc  best  blag  blink(1)  blog  blog:  blogs  books  books…  botqueue:  brei  buffer  build  builder  burst  businesses  but  by  c#  calculator  card  cash_  challenge  channel  charge  combines  compass:  compression  conference  control  cool  course  court  covering  crawl  customer  cvpr  cycling  dale  data  dataset  day  december  delivery  design  developers.  developers  dictation  digital  distributed  divi  diy  docker  doernbecher  dougherty  drone  dtlater  elegant  engagement  etiquette  etsy  experiences  explained  exploring  f  facebook  fall  family  favorite  feature  february  feedly  festivals  finding  first  florida  for...  for  formula  foursquare  free_  freestyle  from  frontpage  fuzzbot  game  gamespot  gaming  gamingnews  german  giantbomb  girlfriend  glow15  goldilocks  google+  google  googlereader  grew  guitar  hack  hacks  hadoop  hardware  hari  hdr+  headset  health  hey_  highlights  hours!  how  how…  hue  i  if  ifttt  ign  image  in  inaturalist  inc  increment  independent  individual  industries  inspiration  instagram  intelligence  internet  intro  introduction  investopedia  ios  is  it's  it  it’s  january  jason  jed  jeffgerstmann  jetsetme  jm  july  june  keybase  kickstarter  language  learned  led  light  lightingpi  lite  local  location-based  luckily  lupefiasco  mac  magazine  magnitude  make  maker  makerbot  makerspace  management  manufacturing  march  marketing  markup  may  me  media  meet  membership  microsoft  minus  minutes  mobile  mode!  modular  molecular_dynamics  more)  multiple  music  musicians'  musicians  my  myecho  n  naomi's  need  nef:  neocities  netflix  network  neural  new  news  newsletter  nike  nima:  no-compromises  not  notifications  november  nutrition  nytimes  o  object  october  oculus  of  offers  on-device  on  open  options  order  organizations  osmo  overhead  page!  pane  part  patchbook  patches  pawsitiv  pay  pc  people  phantom  philips  photography  pi  pinterest  platform  please  poel  posts  potentials  premium  printers  pro  processor  programming  proxies  push  qualcomm’s  quest:  questions:  r  radio  reader  recommendations  record  remembear  renter-friendly  replicator  reporting’s  research  resources  reviews  rgb  rhizome  rock  roles  rsp2  rss  s  saas  salaries  sarahjedwards  sausage  sausages  science  scoring  sdrplay  secrets  secure  semantic  semantris  seo  september  seri  series  server's  service  services  sherlock — user  shiny  side  sign-in:  simple  slack  smith  snapdragon  so  social  solos  solutions  source  south  spam  standalone  starred  static  status  steps  stockx  stop  store  stripe  studio  sweet  syntax  synth  t  talk  teams  techcrunch  technology  temporary  that  the  themes  theory  there's  things  this  through  time.  time_  times  tip  tipping  to...  to  toolkit  to’s:  transparent  trending  triplej  tumblr  twitter  types  typing  u  understand  unearthed  uno-compatible  unsigned  update!  updates  usb  usd  using  ux  video  view  vision  visual...  visual  visualbuilder  vix  vox  vr  wall  way  webdesign  whittel's  willing  windows  wireframe  with  wordpress  works  x  xamarin  yeek  yoast  you're  you  your  yours.  youtube  |       

Copy this bookmark:



description:


tags: